-- Logs begin at Mon 2022-06-20 05:08:23 UTC, end at Mon 2022-06-20 06:22:46 UTC. -- Jun 20 05:55:22.380919 dv-cinder-836996-36-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 05:55:22.390630 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 05:55:22 2022] *** Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: nodename: dv-cinder-836996-36-iscsi Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: machine: x86_64 Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: clock source: unix Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: pcre jit disabled Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: detected number of CPU cores: 4 Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: current working directory: / Jun 20 05:55:22.392869 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: detected binary path: /usr/bin/uwsgi-core Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: your processes number limit is 47680 Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: your memory page size is 4096 bytes Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: detected max file descriptor number: 2048 Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: lock engine: pthread robust mutexes Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: thunder lock: enabled Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 05:55:22.393484 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 05:55:22.436757 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: Python main interpreter initialized at 0x5565b836a9c0 Jun 20 05:55:22.436757 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: python threads support enabled Jun 20 05:55:22.436757 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: your server socket listen backlog is limited to 100 connections Jun 20 05:55:22.436757 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: your mercy for graceful operations on workers is 90 seconds Jun 20 05:55:22.437111 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 05:55:22.437183 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: *** Operational MODE: preforking *** Jun 20 05:55:22.437447 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: *** uWSGI is running in multiple interpreter mode *** Jun 20 05:55:22.437447 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: spawned uWSGI master process (pid: 103300) Jun 20 05:55:22.437633 dv-cinder-836996-36-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 05:55:22.441007 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: spawned uWSGI worker 1 (pid: 103301, cores: 1) Jun 20 05:55:22.441007 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: spawned uWSGI worker 2 (pid: 103302, cores: 1) Jun 20 05:55:22.441007 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 05:55:23.087652 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 05:55:23.090116 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 05:55:24.199606 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:55:24.199606 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: from cryptography.utils import int_from_bytes Jun 20 05:55:24.200510 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:55:24.200510 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: from cryptography.utils import int_from_bytes Jun 20 05:55:24.202679 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:55:24.202679 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: from cryptography.utils import int_from_bytes Jun 20 05:55:24.203116 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:55:24.203116 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: from cryptography.utils import int_from_bytes Jun 20 05:55:26.635329 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:55:26.635884 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:55:26.635972 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:55:26.636310 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:55:26.636470 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:55:26.636541 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:55:26.636707 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:55:26.636803 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:55:26.637041 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:55:26.637141 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.637300 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:55:26.637387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.637681 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.637779 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.637988 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.638084 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.638302 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.638411 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.638603 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.638690 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.638921 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639030 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639220 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639320 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639532 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639625 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639791 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.639885 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.640102 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.640196 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.640397 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.640490 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-36-iscsi {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.640704 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.640804 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.641281 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.641385 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-36-iscsi {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.641587 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.641738 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.641889 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642016 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642184 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642309 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642494 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642628 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642789 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.642914 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.643099 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.643281 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.643433 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.644416 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.644558 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.644678 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.644763 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.644849 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.644940 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.645056 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.645186 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.645309 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.645432 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.645567 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646185 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646312 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646435 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646546 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646672 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646805 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.646929 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647051 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647182 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647318 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-36-iscsi {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647449 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647599 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647733 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-36-iscsi {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.647906 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.648042 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.648214 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.648353 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.648612 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.648751 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.648896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649066 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649262 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649406 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649540 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649665 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649853 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.649982 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.650161 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.650302 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.650481 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.650609 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.650794 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.650923 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.651105 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.651247 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.651417 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.651544 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.651712 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.651839 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652015 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652152 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652317 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652447 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652628 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652767 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.652928 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653075 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653254 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653390 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653516 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653646 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653779 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.653903 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654094 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654234 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654406 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654541 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654719 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654849 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.654972 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655096 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655228 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655363 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655488 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655618 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655796 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.655924 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.656099 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.656238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.656397 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.656523 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.656696 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.656823 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657021 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657152 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657312 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657437 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657608 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657734 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.657904 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658039 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658200 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658326 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658501 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658642 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658843 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.658971 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.659093 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.659224 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.659426 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.659572 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.659697 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.659821 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.660073 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.660313 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.660441 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.660616 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.660948 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.661087 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.661339 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.662041 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.662169 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.662445 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.662572 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.662760 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.663062 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.663191 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.663362 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.663577 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.663711 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.663963 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.664100 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.664288 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.664521 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.664650 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.664887 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.665069 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.665319 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.665448 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.665639 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.665766 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.665953 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.666155 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.666282 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.666586 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.666723 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.666922 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.667049 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.667342 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.667469 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.667654 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.667814 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.667942 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.668235 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.668363 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.668543 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.668879 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.669035 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.669163 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.669284 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.669581 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.669717 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.669883 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.670013 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.670191 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.670395 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.670530 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.670829 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.670970 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.671136 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.671265 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.671439 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.671659 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.671787 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.672029 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.672156 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.672423 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.672550 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.672726 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.672913 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.673105 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.673354 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.673493 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.673678 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.673859 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.673995 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.674276 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.674406 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.674579 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.674719 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.674912 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.675148 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.675284 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.675521 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.675647 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.675824 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.675959 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.676187 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.676325 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.676626 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.676767 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.676956 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.677186 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.677314 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.677539 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.677670 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.677852 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.677979 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.678162 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.678304 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.678463 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.678590 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.678766 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.678900 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679111 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679249 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679373 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679497 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679641 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679831 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.679958 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680090 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680215 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680345 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680491 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680619 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680785 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.680923 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.681124 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.681253 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.681422 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.681548 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.681722 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.681852 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.682019 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.682145 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.682318 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.682446 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.682710 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.682854 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.683065 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.683237 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.683394 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.683730 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.684040 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.684365 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.684690 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.685023 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.685333 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.685633 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.685782 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.685949 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.686086 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.686257 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.686386 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:55:26.686563 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.686723 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.686851 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.687079 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.687220 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.687445 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.687588 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.687768 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.687904 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.688074 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.688278 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.688479 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.688700 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.688842 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.688967 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.689159 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.689356 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.689499 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.689717 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.689871 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690004 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690131 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690255 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690378 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690503 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690627 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690838 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.690967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.691177 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.691316 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.691487 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.691615 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.691808 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.691946 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.692124 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.692262 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.692430 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.692575 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.692761 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.692890 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.693093 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.693237 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.693412 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.693540 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.693740 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.693883 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694048 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694185 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694359 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694487 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694664 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694792 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.694969 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.695105 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.695274 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.695411 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.695580 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.695708 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.695883 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696023 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696212 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696341 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696521 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696650 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696830 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.696959 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.697164 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.697292 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.697477 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.697606 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.697782 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.697911 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698087 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698391 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698528 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698691 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698820 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.698990 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.699118 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.699288 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.699505 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.699636 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.699768 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.699893 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700013 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700183 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700324 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700503 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700625 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700804 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.700933 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.701140 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.701283 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.701446 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.701581 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.701753 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.701881 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702054 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702190 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702357 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702483 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702656 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702787 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.702960 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.703089 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.703263 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.703400 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.703560 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.703686 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.703876 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704005 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704179 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704318 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704478 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704607 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704792 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.704922 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.705114 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.705245 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.705413 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.705542 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.705724 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.705854 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706027 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706154 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706328 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706464 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706631 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706759 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.706936 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707063 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707246 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707392 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707553 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707681 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707855 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.707991 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.708673 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.708812 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.708995 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.709142 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.709310 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.709438 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.709639 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.709775 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.709909 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710033 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710221 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710348 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710533 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710660 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710843 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.710969 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.711208 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.711332 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.711507 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.711633 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.711807 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.711947 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.712110 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.712245 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.712408 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.712537 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.712707 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.712841 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713027 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713158 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713329 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713457 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713628 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713763 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.713942 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714095 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714349 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714479 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714602 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714734 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714859 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.714991 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.715117 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.715240 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.715410 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.715538 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.715707 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.715853 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.716041 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.716177 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.716371 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.716507 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.716673 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.716884 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717039 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717167 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717290 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717432 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717598 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717727 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.717900 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718036 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718202 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718330 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718505 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718638 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718810 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.718938 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.719125 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.719259 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.719430 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.719567 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.719777 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.719905 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720040 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720164 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720337 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720466 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720640 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720775 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.720959 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.721113 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.721283 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.721407 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.721595 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.721738 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.721900 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722037 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722211 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722348 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722531 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722651 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722840 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.722983 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.723141 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.723268 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.723450 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.723579 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.723815 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.724531 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.724669 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.724808 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.724934 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.725083 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.725251 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.725397 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.725564 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.725694 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.725872 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726000 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726184 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726320 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726489 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726618 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726806 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.726935 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.727110 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.727248 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.727422 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.727551 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.727721 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.727849 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728028 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728156 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728337 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728466 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728645 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728779 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.728952 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.729132 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.729279 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.729420 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.729594 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.729734 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.729898 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730026 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730204 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730331 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730514 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730662 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730818 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.730943 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.731118 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.731246 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.731424 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.731561 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.731734 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.731871 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732039 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732168 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732344 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732490 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732644 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732783 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.732954 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.733107 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.733281 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.733420 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.733582 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.733709 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.733880 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734008 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734179 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734307 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734483 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734687 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734815 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.734937 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.735093 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.735221 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.735402 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.735532 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.735702 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.735836 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736004 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736125 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736316 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736443 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736620 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736746 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.736920 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737103 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737241 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737367 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737531 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737667 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737849 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.737984 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.738158 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.738286 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.738453 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.738589 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.738765 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.738893 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.739072 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.739199 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.739401 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.739544 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.739714 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.739840 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740020 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740148 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740321 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740454 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740623 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740752 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.740925 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741255 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741383 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741562 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741691 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741868 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.741996 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.742174 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.742307 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.742481 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.742638 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.742787 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.742913 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.743090 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.743224 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.743394 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.743530 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.743699 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.743828 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744000 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744129 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744307 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744443 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744612 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744829 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.744959 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.745199 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.745341 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.745527 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.745657 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.745859 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.745994 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.746119 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.746242 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.746437 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.746566 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.746743 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.746895 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.747063 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.747190 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.747384 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.747519 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.747715 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.747844 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.748013 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.748150 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.748315 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.748583 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.748712 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.748900 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749058 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749229 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749359 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749528 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749656 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749827 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.749958 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.750124 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.750253 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.750426 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.750567 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.750728 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.750857 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751026 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751146 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751320 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751459 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751617 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751746 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.751926 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752064 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752224 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752353 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752527 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752658 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752825 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.752945 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.753167 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.753296 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.753471 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.753601 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.753767 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.753895 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.754064 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.754193 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.754360 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.754490 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.754669 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.754810 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755007 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755145 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755307 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755442 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755617 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755744 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.755929 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.756065 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.756232 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.756368 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.756530 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.756655 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.756846 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757004 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757167 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757293 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757466 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757605 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757764 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.757906 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758067 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758194 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758370 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758504 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758667 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758802 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.758969 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.759096 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.759271 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.759407 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.759574 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.759701 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.759875 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760001 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760170 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760296 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760472 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760593 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760775 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.760902 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.761107 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.761235 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.761412 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.761548 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.761711 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.761837 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762009 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762144 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762310 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762435 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762612 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762738 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.762908 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763043 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763212 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763338 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763505 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763639 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763810 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.763944 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.764106 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.764231 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.764403 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.764537 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.764698 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.764839 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.765017 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.765146 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.765322 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.765430 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.765618 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.765716 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.766176 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.766273 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.766476 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.766569 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.766774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.766869 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767071 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767165 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767372 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767467 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767670 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767765 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.767965 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768265 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768359 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768574 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768677 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768881 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.768998 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.769203 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.769381 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.769506 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.769592 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.769804 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.769890 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.770102 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.770197 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.770402 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.770486 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.771224 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.771335 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.771526 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.771632 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.771823 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.771924 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.772123 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.772226 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.772420 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.772515 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.772718 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.772802 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773055 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773205 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773355 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773494 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773643 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773773 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.773942 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774073 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774238 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774380 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774543 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774670 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774848 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.774975 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.775158 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.775261 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.775463 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.775558 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.775766 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.775871 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776070 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776165 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776469 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776682 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776786 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.776994 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777089 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777303 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777411 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777603 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777708 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777906 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.777999 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.778215 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.778310 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.778515 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.778617 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.778814 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.778909 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.779130 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.779231 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.779434 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.779540 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.779738 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.779833 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780051 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780146 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780363 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780457 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780667 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780762 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.780963 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.781074 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.781311 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.781401 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.781620 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.781718 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.781921 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782007 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782224 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782310 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782528 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782620 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782832 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.782924 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.783141 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.783298 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.783450 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.783597 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.783744 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.783893 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784042 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784182 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784319 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784457 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784594 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784741 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.784880 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.785060 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.785205 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.785438 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.785585 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.785740 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.785893 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.786031 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.786169 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.786900 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787042 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787197 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787341 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787479 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787617 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787767 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.787912 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788059 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788207 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788353 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788493 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788630 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788778 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.788917 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789222 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789360 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789498 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789664 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789806 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.789944 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790080 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790228 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790367 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790515 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790654 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790853 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.790998 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.791145 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.791318 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.791505 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.791668 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.791808 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.791948 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792085 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792236 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792375 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792512 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792649 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792786 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.792963 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.793143 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.793290 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.793439 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.793577 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.793714 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.793851 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794003 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794152 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794326 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794480 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794620 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794757 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.794929 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.795131 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.795276 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.795453 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.795664 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.795819 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.795959 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.796106 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.796252 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.796392 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.796536 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.796684 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.796824 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797018 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797168 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797313 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797466 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797617 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797757 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.797895 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798032 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798207 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798430 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798573 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798719 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798859 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.798996 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.799134 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.799281 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.799432 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.799601 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.799774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.799924 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.800064 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.800202 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.800341 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.800513 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.800660 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.800836 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.801005 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.801221 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.801379 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.801528 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.801667 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.801866 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802016 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802205 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802359 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802516 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802656 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802839 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.802993 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.803133 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.803272 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.803452 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.803600 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.803759 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.803916 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.804081 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.804237 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.804378 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.804516 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.804681 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.804828 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805002 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805163 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805305 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805458 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805605 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805828 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.805974 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806123 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806264 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806410 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806562 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806702 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806854 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.806995 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.807134 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.807291 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.807431 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.807589 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.807740 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.807886 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808025 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808163 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808310 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808449 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808673 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808817 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.808956 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809122 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809284 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809425 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809577 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809717 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809855 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.809994 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810132 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810270 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810418 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810568 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810847 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.810985 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.811142 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.811330 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.811482 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.811630 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.811770 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.811908 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.812055 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.812195 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.812395 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.812552 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.812721 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.812868 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813085 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813243 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813391 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813531 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813669 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813825 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.813977 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814117 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814264 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814404 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814554 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814707 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814847 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.814996 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.815147 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.815287 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.815426 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.815573 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.815713 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.815866 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816084 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816228 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816368 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816519 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816670 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816810 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.816958 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.817128 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.817281 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.817449 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.817718 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.817864 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818004 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818150 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818300 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818441 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818619 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818773 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.818913 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.819061 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.819211 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.819350 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.819523 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.819677 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.819855 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820000 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820149 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820289 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820435 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820574 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820740 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.820897 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821112 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821257 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821396 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821533 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821683 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821832 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.821972 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822118 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822259 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822543 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822689 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822849 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.822989 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.823128 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.823265 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.823411 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.823567 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.823707 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.823844 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.824018 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.824174 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.824403 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.824558 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.824731 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.824886 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825061 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825207 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825361 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825502 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825677 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825830 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.825993 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.826220 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.826375 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.826518 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.826656 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.826792 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.826940 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827079 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827226 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827366 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827505 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827643 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827787 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.827944 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.828084 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.828222 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.828394 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.828543 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.828693 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.828840 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.829039 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.829228 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.829375 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.829559 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.829717 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.829867 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830007 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830176 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830322 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830489 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830688 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830834 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.830974 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831112 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831250 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831387 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831534 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831673 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831821 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.831984 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.832131 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.832294 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.832464 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.832605 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.832743 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.832916 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.833611 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.833773 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.833916 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834055 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834193 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834355 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834510 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834659 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834809 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.834956 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.835102 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.835283 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.835440 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.835589 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.835729 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.835881 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.836029 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.836176 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.836355 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.836496 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.836652 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.836843 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837015 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837190 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837414 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837557 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837695 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837842 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.837982 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.838130 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.838270 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.838407 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.838556 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.838713 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.838863 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839012 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839153 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839291 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839430 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839575 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839714 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.839861 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840013 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840197 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840352 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840511 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840660 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840800 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.840939 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.841134 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.841275 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.841436 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.841595 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.841735 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.841951 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.842106 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.842246 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.842554 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.842724 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.842873 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843011 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843192 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843339 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843495 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843693 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843837 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.843976 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.844123 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.844262 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.844411 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.844552 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.844701 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.844847 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845012 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845160 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845311 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845452 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845590 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845737 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.845884 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846023 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846171 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846309 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846459 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846604 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846744 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.846882 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.847029 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.847177 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.847321 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.847579 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.847734 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.847892 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.848038 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.848190 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.848335 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.848490 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.848636 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.849390 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.849547 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.849693 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.849837 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.849990 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.850143 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.850303 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.850449 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.850603 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.850796 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.850988 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.851157 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.851314 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.851469 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.851623 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.851776 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.851921 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852074 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852220 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852365 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852510 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852656 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852800 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.852952 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.853137 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.853284 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.853428 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.853573 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.853718 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.853875 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854022 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854166 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854318 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854463 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854608 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854769 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.854954 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.855115 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.855269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.855415 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.855568 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.855715 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.855860 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856005 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856157 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856302 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856461 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856608 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856753 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856909 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.856909 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.857234 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.857397 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.857551 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.857698 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.857843 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.857997 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.858178 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.858343 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.858490 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.858642 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.858788 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.858945 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.859099 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.859245 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.859401 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.859547 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.859699 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.859846 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860001 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860147 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860298 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860450 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860596 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860777 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.860947 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.861121 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.861278 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.861423 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.861575 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.861721 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.861875 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862028 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862174 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862174 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862461 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862615 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862779 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.862925 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863077 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863225 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863376 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863531 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863677 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863822 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.863974 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864120 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864274 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864463 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864611 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864766 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864912 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.864912 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.865259 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.865512 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.865664 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.865810 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.865981 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866134 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866360 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866518 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866662 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866769 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866899 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.866991 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.867210 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.867316 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.867527 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.867627 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.867855 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.867956 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.868169 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.868258 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.868474 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.868562 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.868788 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.868885 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.869156 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.869247 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.869473 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.869564 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.869789 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.869889 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.870103 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.870197 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.870417 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.870513 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.870727 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.870826 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871033 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871118 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871351 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871469 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871659 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871783 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.871985 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.872086 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.872323 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.872429 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.872650 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.872738 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.872970 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.873070 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.873296 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.873427 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.873599 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.873740 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.873901 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.874058 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.874208 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.874377 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.874523 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.874686 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.874829 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875006 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875128 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875327 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875414 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875638 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875725 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.875958 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.876045 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.876267 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.876361 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.876580 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.876730 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.876881 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877004 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877214 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877312 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877526 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877661 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877812 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.877909 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.878111 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.878197 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.878409 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.878495 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.878707 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.878801 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879005 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879091 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879308 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879401 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879604 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879699 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879904 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.879997 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.880224 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.880308 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.880523 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.880610 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.880822 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.880906 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.881151 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.881252 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.881455 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.881542 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.881763 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.881849 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882066 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882152 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882371 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882477 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882672 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882766 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.882973 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883059 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883275 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883362 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883574 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883662 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883881 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.883974 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.884180 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.884266 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.884482 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.884568 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.884781 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.884876 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.885105 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.885209 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.885454 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.885546 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.885715 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.885812 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886020 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886106 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886326 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886412 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886648 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886742 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.886954 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887043 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887255 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887341 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887563 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887656 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887873 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.887967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.888186 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.888280 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.888494 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.888580 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.888800 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.888884 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.889143 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.889230 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.889450 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.889538 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.889757 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.889842 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.890061 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.890159 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.890367 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.890452 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.890670 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.890754 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.891229 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.891329 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.891539 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.891626 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.891859 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.891945 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.892159 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.892257 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.892473 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.892571 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.892784 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.892868 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.893124 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.893228 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.893439 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.893532 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.893747 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.893833 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.894074 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.894161 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.894383 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.894469 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.894691 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.894775 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.895000 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.895088 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.895300 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.895386 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.895541 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:55:26.896125 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.896427 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.896743 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.897095 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.897422 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.897732 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.898058 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.898384 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.898731 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.899044 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.899385 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.899713 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.900027 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.900337 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.900639 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:55:26.900882 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:55:27.053677 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Registered counter for database nova_api Jun 20 05:55:27.055290 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO dbcounter [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Registered counter for database nova_api Jun 20 05:55:27.075566 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.077222 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_db.sqlalchemy.engines [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.082511 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.084164 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writer thread running {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.139840 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.context [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40624e2c-0e91-4c97-b143-ade440b678f9(cell1) {{(pid=103301) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 05:55:27.140242 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.context [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40624e2c-0e91-4c97-b143-ade440b678f9(cell1) {{(pid=103302) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 05:55:27.143934 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 05:55:27.144375 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 05:55:27.146217 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 05:55:27.146543 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 05:55:27.147030 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 05:55:27.147320 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 05:55:27.149031 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 05:55:27.149276 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 05:55:27.151139 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Registered counter for database nova_cell0 Jun 20 05:55:27.151237 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO dbcounter [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Registered counter for database nova_cell0 Jun 20 05:55:27.155211 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO dbcounter [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Registered counter for database nova_cell1 Jun 20 05:55:27.155417 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Registered counter for database nova_cell1 Jun 20 05:55:27.162448 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_db.sqlalchemy.engines [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.163609 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_db.sqlalchemy.engines [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.166128 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.168001 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.169602 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writer thread running {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.172373 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writer thread running {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.174110 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.176381 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.316543 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO dbcounter [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Registered counter for database nova_cell0 Jun 20 05:55:27.323159 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Registered counter for database nova_cell0 Jun 20 05:55:27.323885 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_db.sqlalchemy.engines [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.328384 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writer thread running {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.329821 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:55:27.334677 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:55:27.662876 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: WARNING keystonemiddleware.auth_token [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 05:55:27.670415 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: WARNING keystonemiddleware.auth_token [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 05:55:27.677709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 05:55:27.684819 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 05:55:28.009333 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: WARNING keystonemiddleware.auth_token [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 05:55:28.015235 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: WARNING keystonemiddleware.auth_token [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 05:55:28.020718 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565b836a9c0 pid: 103302 (default app) Jun 20 05:55:28.022797 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:55:28.023988 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Jun 20 05:55:28.024501 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Jun 20 05:55:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:55:28.027231 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 05:55:28.033207 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-8eb68541-5170-4c60-9d15-24e3aa81e13f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 05:55:28.039060 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565b836a9c0 pid: 103301 (default app) Jun 20 05:56:42.575621 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:42.576613 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 20 05:56:42.577064 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:42.588651 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=3 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:42.589737 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell0:SELECT=3 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:42.590435 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell1:SELECT=3 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:42.591605 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:43.022107 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1c89215a-0707-41e1-a5bc-27d17db18070 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:43.052455 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1c89215a-0707-41e1-a5bc-27d17db18070 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.468820 Jun 20 05:56:43.065739 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 20 05:56:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:56:45.134072 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:45.135056 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-27ad1ef9-83e5-4d6d-ab78-6be6ed84b7de None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 20 05:56:45.135474 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:45.200472 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-7e34aa6f-2634-4b6c-8f65-cd22b698a429 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:45.219246 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 05:56:45.219246 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Jun 20 05:56:45.256516 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-7e34aa6f-2634-4b6c-8f65-cd22b698a429 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114764 Jun 20 05:56:45.257711 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:56:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:45.271284 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_api:SELECT=3 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:45.272260 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_cell0:SELECT=3 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:45.273434 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_cell1:SELECT=3 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:45.274163 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:45.480447 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-79237218-1ce9-425f-8b50-f0148243b497 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:45.482796 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 05:56:45.482796 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: warnings.warn(msg) Jun 20 05:56:45.547212 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-79237218-1ce9-425f-8b50-f0148243b497 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281141 Jun 20 05:56:45.551059 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 20 05:56:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:56:47.620349 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-7e34aa6f-2634-4b6c-8f65-cd22b698a429 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:47.621410 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-7e34aa6f-2634-4b6c-8f65-cd22b698a429 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 20 05:56:47.621825 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:47.728355 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-956b93cd-a7cf-4a56-af44-257ebbfe837b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:47.746927 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 05:56:47.746927 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: warnings.warn(msg) Jun 20 05:56:47.765888 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-956b93cd-a7cf-4a56-af44-257ebbfe837b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137719 Jun 20 05:56:47.766436 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:56:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:47.778306 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f32de355-d185-4cdf-86d9-6d1469fcdd60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:47.779858 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 05:56:47.779858 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Jun 20 05:56:47.819208 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-f32de355-d185-4cdf-86d9-6d1469fcdd60 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044696 Jun 20 05:56:47.819887 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 20 05:56:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:56:49.935443 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-956b93cd-a7cf-4a56-af44-257ebbfe837b admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:49.936476 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-956b93cd-a7cf-4a56-af44-257ebbfe837b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 20 05:56:49.936866 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:49.996762 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-dce4043a-6a38-49bc-8fba-f0e8e3ec388f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:50.016829 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-dce4043a-6a38-49bc-8fba-f0e8e3ec388f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074031 Jun 20 05:56:50.024961 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:56:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 05:56:50.030192 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-ce8cc308-3640-4b53-98fe-77c7f4d1e8f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:50.056507 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-ce8cc308-3640-4b53-98fe-77c7f4d1e8f7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030102 Jun 20 05:56:50.057637 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 20 05:56:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:56:52.149250 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-dce4043a-6a38-49bc-8fba-f0e8e3ec388f admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:52.150262 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-dce4043a-6a38-49bc-8fba-f0e8e3ec388f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 20 05:56:52.150837 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:52.208909 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-908b7d6a-eb9c-4d27-91c7-d54d60c5aaf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "ram": 2048, "swap": 0}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:52.226950 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-908b7d6a-eb9c-4d27-91c7-d54d60c5aaf7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070706 Jun 20 05:56:52.228233 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:56:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:52.239185 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-ce11d3d9-597b-4454-b7c3-64804b422305 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:52.260818 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-ce11d3d9-597b-4454-b7c3-64804b422305 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025331 Jun 20 05:56:52.261432 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 20 05:56:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 05:56:54.325390 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-908b7d6a-eb9c-4d27-91c7-d54d60c5aaf7 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:54.326330 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-908b7d6a-eb9c-4d27-91c7-d54d60c5aaf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 20 05:56:54.326865 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:54.388785 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-18f42b04-b00a-4f76-852a-2b7172979f28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:54.406203 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-18f42b04-b00a-4f76-852a-2b7172979f28 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072776 Jun 20 05:56:54.406749 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:56:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:54.418413 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-7a61eaee-0d84-445e-b02b-44be4f3cc20b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:54.441416 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-7a61eaee-0d84-445e-b02b-44be4f3cc20b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026542 Jun 20 05:56:54.442161 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 20 05:56:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:56:56.523989 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-18f42b04-b00a-4f76-852a-2b7172979f28 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:56.525017 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-18f42b04-b00a-4f76-852a-2b7172979f28 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 20 05:56:56.525424 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:56.587210 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-626f6ec6-9f64-4192-9d3e-5b21ec4f8b9e admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:56.610308 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-626f6ec6-9f64-4192-9d3e-5b21ec4f8b9e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078922 Jun 20 05:56:56.610854 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 20 05:56:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:56:58.684834 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-18f42b04-b00a-4f76-852a-2b7172979f28 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:56:58.685993 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-18f42b04-b00a-4f76-852a-2b7172979f28 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 20 05:56:58.686392 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:56:58.748478 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-9993c728-1e65-4ad1-b2d4-51b56e82176e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "id": "1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:58.767486 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-9993c728-1e65-4ad1-b2d4-51b56e82176e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075319 Jun 20 05:56:58.768029 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:56:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:58.779908 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f911fb73-63aa-46bd-9d7c-d6ca4456f8af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:56:58.803696 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-f911fb73-63aa-46bd-9d7c-d6ca4456f8af admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027453 Jun 20 05:56:58.804291 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 20 05:56:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:00.853366 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-9993c728-1e65-4ad1-b2d4-51b56e82176e admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:00.854407 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-9993c728-1e65-4ad1-b2d4-51b56e82176e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 20 05:57:00.854824 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:00.916993 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-cd053850-8403-4602-85c9-78d1944be56f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:00.935122 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-cd053850-8403-4602-85c9-78d1944be56f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074382 Jun 20 05:57:00.935697 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:57:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 05:57:00.948594 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-8dd7ccc0-b29c-40a7-88b2-bb2d0f83201a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:00.975501 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-8dd7ccc0-b29c-40a7-88b2-bb2d0f83201a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030886 Jun 20 05:57:00.976538 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 20 05:57:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:03.442164 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-cd053850-8403-4602-85c9-78d1944be56f admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:03.443227 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-cd053850-8403-4602-85c9-78d1944be56f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 20 05:57:03.443635 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:03.512643 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-9aaba011-8982-46ee-b902-7d416567e47b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "disk": 40, "swap": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:03.534429 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-9aaba011-8982-46ee-b902-7d416567e47b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085002 Jun 20 05:57:03.535131 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:57:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:03.549484 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-9833d04b-4046-4e23-987b-3b14687c8795 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:03.572243 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-9833d04b-4046-4e23-987b-3b14687c8795 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027143 Jun 20 05:57:03.572813 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 20 05:57:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:05.660663 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-9aaba011-8982-46ee-b902-7d416567e47b admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:05.661714 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-9aaba011-8982-46ee-b902-7d416567e47b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 20 05:57:05.662264 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:05.719360 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-dd4f655d-ed9d-42e2-adc7-322d0218c768 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "vcpus": 4}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:05.737979 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-dd4f655d-ed9d-42e2-adc7-322d0218c768 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070284 Jun 20 05:57:05.738525 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:57:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:05.750449 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-b272cdbe-7686-4dd4-a7c4-b5ce9155cfd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:05.773508 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-b272cdbe-7686-4dd4-a7c4-b5ce9155cfd7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026649 Jun 20 05:57:05.774001 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 20 05:57:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:07.851601 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-dd4f655d-ed9d-42e2-adc7-322d0218c768 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:07.853299 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-dd4f655d-ed9d-42e2-adc7-322d0218c768 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Jun 20 05:57:07.853824 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:07.914638 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-f6aed71f-2457-412c-b541-1ad44655117c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "ram": 16384}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:07.935343 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-f6aed71f-2457-412c-b541-1ad44655117c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075645 Jun 20 05:57:07.935893 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 20 05:57:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 05:57:07.948058 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-5e6c1c7a-7b66-4f55-9a9c-d9386d1e24dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:07.972393 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-5e6c1c7a-7b66-4f55-9a9c-d9386d1e24dd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028199 Jun 20 05:57:07.972995 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 20 05:57:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:31.963851 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-f6aed71f-2457-412c-b541-1ad44655117c admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:31.964858 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-f6aed71f-2457-412c-b541-1ad44655117c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 20 05:57:31.965423 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:31.976342 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.024184 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-7ec0c7aa-a825-4331-9df1-add6d43e3577 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:32.040723 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-7ec0c7aa-a825-4331-9df1-add6d43e3577 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069400 Jun 20 05:57:32.041280 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 20 05:57:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:57:32.948667 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-f6aed71f-2457-412c-b541-1ad44655117c admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:32.949703 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-f6aed71f-2457-412c-b541-1ad44655117c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 20 05:57:32.950105 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:33.137259 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-d090def2-27c7-4c17-994c-38faeb80bb2b admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:33.143160 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.wsgi [None req-d090def2-27c7-4c17-994c-38faeb80bb2b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-d090def2-27c7-4c17-994c-38faeb80bb2b admin admin] Request method failure captured: Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Accept: application/json Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Accept-Encoding: gzip, deflate Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Connection: keep-alive Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Content-Length: 0 Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Host: 10.222.0.20 Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Openstack-Api-Version: compute 2.90 Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Openstack-System-Scope: None Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: User-Agent: python-novaclient Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Auth-Token: gAAAAABisAxMiiZ-GPAZz6mvtzntnEXgwcQs0W0Zvv4qaUt8dY-pepbUNj92tb6wzQeLKTxXbOl2HAhvjPs53UN8ot-Kkq4jfyeov4nwY5lydjm8_bsx9rCZdkahKXUEwM5lrnvgVR7LUCCzbme11Dgc5Y8-YMoNXiHlW9QowVUaXuubrmhkCbc Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Domain-Id: None Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Domain-Name: None Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Identity-Status: Confirmed Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Is-Admin-Project: True Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Domain-Id: default Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Domain-Name: Default Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Name: admin Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Role: admin,reader,member Jun 20 05:57:33.146467 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Roles: admin,reader,member Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f271df74ec2467682bcd9230f451749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f271df74ec2467682bcd9230f451749", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant: admin Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant-Name: admin Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User: admin Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Domain-Id: default Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Domain-Name: Default Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Id: 03c25f17f05341ab8190ac8b2fc040ce Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Name: admin Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: method: > Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: exception: Flavor 42 could not be found. Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: action_args: {'id': '42'} Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 05:57:33.148028 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:33.149083 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.150533 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-d090def2-27c7-4c17-994c-38faeb80bb2b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 05:57:33.151870 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-d090def2-27c7-4c17-994c-38faeb80bb2b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061770 Jun 20 05:57:33.151870 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 20 05:57:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 05:57:33.157446 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-dfedaa8a-9bde-422d-b81e-1e93d818e796 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:33.161007 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.180385 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-dfedaa8a-9bde-422d-b81e-1e93d818e796 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026401 Jun 20 05:57:33.180910 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 20 05:57:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:57:33.190513 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-eaf7b1e2-8f76-4945-8181-b15262f86c76 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:33.212558 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-eaf7b1e2-8f76-4945-8181-b15262f86c76 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025593 Jun 20 05:57:33.213761 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 20 05:57:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 05:57:33.222995 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-cbf20f1f-4473-42cf-a2a7-3eb3e8c6ca75 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:33.229192 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.wsgi [None req-cbf20f1f-4473-42cf-a2a7-3eb3e8c6ca75 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-cbf20f1f-4473-42cf-a2a7-3eb3e8c6ca75 admin admin] Request method failure captured: Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Accept: application/json Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Accept-Encoding: gzip, deflate Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Connection: keep-alive Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Content-Length: 0 Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Host: 10.222.0.20 Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Openstack-Api-Version: compute 2.90 Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Openstack-System-Scope: None Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: User-Agent: python-novaclient Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Auth-Token: gAAAAABisAxMiiZ-GPAZz6mvtzntnEXgwcQs0W0Zvv4qaUt8dY-pepbUNj92tb6wzQeLKTxXbOl2HAhvjPs53UN8ot-Kkq4jfyeov4nwY5lydjm8_bsx9rCZdkahKXUEwM5lrnvgVR7LUCCzbme11Dgc5Y8-YMoNXiHlW9QowVUaXuubrmhkCbc Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Domain-Id: None Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Domain-Name: None Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Identity-Status: Confirmed Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Is-Admin-Project: True Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Domain-Id: default Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Domain-Name: Default Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Name: admin Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Role: admin,reader,member Jun 20 05:57:33.232405 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Roles: admin,reader,member Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f271df74ec2467682bcd9230f451749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f271df74ec2467682bcd9230f451749", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant: admin Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant-Name: admin Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User: admin Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Domain-Id: default Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Domain-Name: Default Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Id: 03c25f17f05341ab8190ac8b2fc040ce Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Name: admin Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: method: > Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: exception: Flavor 42 could not be found. Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: action_args: {'id': '42'} Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 05:57:33.233960 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:33.234932 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:33.237040 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-cbf20f1f-4473-42cf-a2a7-3eb3e8c6ca75 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 05:57:33.238316 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-cbf20f1f-4473-42cf-a2a7-3eb3e8c6ca75 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014833 Jun 20 05:57:33.238316 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 20 05:57:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 05:57:34.046314 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-eaf7b1e2-8f76-4945-8181-b15262f86c76 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:34.047352 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-eaf7b1e2-8f76-4945-8181-b15262f86c76 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 20 05:57:34.047748 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:34.235087 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-20411e04-8fbb-4e76-8288-60988dffb80b admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:34.243014 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.wsgi [None req-20411e04-8fbb-4e76-8288-60988dffb80b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-20411e04-8fbb-4e76-8288-60988dffb80b admin admin] Request method failure captured: Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Accept: application/json Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Accept-Encoding: gzip, deflate Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Connection: keep-alive Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Content-Length: 0 Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Host: 10.222.0.20 Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Openstack-Api-Version: compute 2.90 Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Openstack-System-Scope: None Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: User-Agent: python-novaclient Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Auth-Token: gAAAAABisAxO_WszwbLztII_RI7Veq4vjGyNwYypahR2Udtxeh2MqKVaCh2YsIUY7sn2U8cngIav7ePW49KUGfAlh9iVeNxnT_CVOeTWv5Gdz2rX4heSEF0SqVXrTkrODpcwQn92_AZPgxO_cw_bwO9UiI-FZQg1UMlnDBq9LHJjpohCZPueRUg Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Domain-Id: None Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Domain-Name: None Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Identity-Status: Confirmed Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Is-Admin-Project: True Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Domain-Id: default Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Domain-Name: Default Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Name: admin Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Role: admin,reader,member Jun 20 05:57:34.244502 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Roles: admin,reader,member Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f271df74ec2467682bcd9230f451749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f271df74ec2467682bcd9230f451749", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant: admin Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant-Name: admin Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User: admin Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Domain-Id: default Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Domain-Name: Default Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Id: 03c25f17f05341ab8190ac8b2fc040ce Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Name: admin Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: method: > Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: exception: Flavor 84 could not be found. Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: action_args: {'id': '84'} Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 05:57:34.246067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:34.246967 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.248238 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-20411e04-8fbb-4e76-8288-60988dffb80b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 05:57:34.249511 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-20411e04-8fbb-4e76-8288-60988dffb80b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063235 Jun 20 05:57:34.249511 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 20 05:57:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 05:57:34.256199 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f93764eb-6828-4938-9a5d-8ab1c3f7b019 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:34.269825 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-f93764eb-6828-4938-9a5d-8ab1c3f7b019 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017899 Jun 20 05:57:34.270358 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 20 05:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:57:34.279589 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-0fc9f694-2776-421f-9169-b939d0106122 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:34.293063 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-0fc9f694-2776-421f-9169-b939d0106122 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016908 Jun 20 05:57:34.293579 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 20 05:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:57:34.303097 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-7cbe2916-1f8d-4287-9bda-baa1de5bafa6 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:34.308362 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.wsgi [None req-7cbe2916-1f8d-4287-9bda-baa1de5bafa6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-7cbe2916-1f8d-4287-9bda-baa1de5bafa6 admin admin] Request method failure captured: Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Accept: application/json Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Accept-Encoding: gzip, deflate Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Connection: keep-alive Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Content-Length: 0 Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Host: 10.222.0.20 Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Openstack-Api-Version: compute 2.90 Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Openstack-System-Scope: None Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: User-Agent: python-novaclient Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Auth-Token: gAAAAABisAxO_WszwbLztII_RI7Veq4vjGyNwYypahR2Udtxeh2MqKVaCh2YsIUY7sn2U8cngIav7ePW49KUGfAlh9iVeNxnT_CVOeTWv5Gdz2rX4heSEF0SqVXrTkrODpcwQn92_AZPgxO_cw_bwO9UiI-FZQg1UMlnDBq9LHJjpohCZPueRUg Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Domain-Id: None Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Domain-Name: None Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Identity-Status: Confirmed Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Is-Admin-Project: True Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Domain-Id: default Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Domain-Name: Default Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Name: admin Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Role: admin,reader,member Jun 20 05:57:34.309896 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Roles: admin,reader,member Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f271df74ec2467682bcd9230f451749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f271df74ec2467682bcd9230f451749", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant: admin Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant-Name: admin Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User: admin Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Domain-Id: default Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Domain-Name: Default Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Id: 03c25f17f05341ab8190ac8b2fc040ce Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Name: admin Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: method: > Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: exception: Flavor 84 could not be found. Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: action_args: {'id': '84'} Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 05:57:34.311376 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:34.312387 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:34.313709 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-7cbe2916-1f8d-4287-9bda-baa1de5bafa6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 05:57:34.315553 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-7cbe2916-1f8d-4287-9bda-baa1de5bafa6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011630 Jun 20 05:57:34.315553 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 20 05:57:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 05:57:35.130013 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-0fc9f694-2776-421f-9169-b939d0106122 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:35.131027 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-0fc9f694-2776-421f-9169-b939d0106122 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 20 05:57:35.131416 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:35.323315 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-8c536252-782f-4620-b58f-09def792b463 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:35.328950 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.wsgi [None req-8c536252-782f-4620-b58f-09def792b463 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-8c536252-782f-4620-b58f-09def792b463 admin admin] Request method failure captured: Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Accept: application/json Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Accept-Encoding: gzip, deflate Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Connection: keep-alive Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Content-Length: 0 Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Host: 10.222.0.20 Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Openstack-Api-Version: compute 2.90 Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Openstack-System-Scope: None Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: User-Agent: python-novaclient Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Auth-Token: gAAAAABisAxPFJ__09fSV8u-Lv_qN1f6J0uzhf3yjkkyrc038l6LO5AuZP83iLvzVbrxaUZAz23eTp_ttnwsB6XHKP46uNOTp_OOYtWri21l5wyuCEueOliu9aZo0kQFr7Z3VRChqhz-UP9WBzs-ZlS1A2tr-qCu2FaAVieOEc7NXPyBy20ZFhM Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Domain-Id: None Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Domain-Name: None Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Identity-Status: Confirmed Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Is-Admin-Project: True Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Domain-Id: default Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Domain-Name: Default Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Project-Name: admin Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Role: admin,reader,member Jun 20 05:57:35.331269 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Roles: admin,reader,member Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f271df74ec2467682bcd9230f451749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f271df74ec2467682bcd9230f451749", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant: admin Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-Tenant-Name: admin Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User: admin Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Domain-Id: default Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Domain-Name: Default Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Id: 03c25f17f05341ab8190ac8b2fc040ce Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: X-User-Name: admin Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: method: > Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: exception: Flavor 451 could not be found. Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: action_args: {'id': '451'} Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 05:57:35.332776 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:35.333774 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.335072 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-8c536252-782f-4620-b58f-09def792b463 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 05:57:35.336332 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-8c536252-782f-4620-b58f-09def792b463 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061576 Jun 20 05:57:35.336332 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 20 05:57:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 05:57:35.342191 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-f8d5dcb2-c6b9-4bd2-82f1-7b81e41f5589 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:35.355559 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-f8d5dcb2-c6b9-4bd2-82f1-7b81e41f5589 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016952 Jun 20 05:57:35.356078 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 20 05:57:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:57:35.364931 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:35.378668 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017090 Jun 20 05:57:35.379185 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 20 05:57:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 05:57:35.387994 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-d4dc3ab9-d516-4f98-8384-67365d1ba9e4 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:35.394389 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.wsgi [None req-d4dc3ab9-d516-4f98-8384-67365d1ba9e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-d4dc3ab9-d516-4f98-8384-67365d1ba9e4 admin admin] Request method failure captured: Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Accept: application/json Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Accept-Encoding: gzip, deflate Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Connection: keep-alive Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Content-Length: 0 Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Host: 10.222.0.20 Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Openstack-Api-Version: compute 2.90 Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Openstack-System-Scope: None Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: User-Agent: python-novaclient Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Auth-Token: gAAAAABisAxPFJ__09fSV8u-Lv_qN1f6J0uzhf3yjkkyrc038l6LO5AuZP83iLvzVbrxaUZAz23eTp_ttnwsB6XHKP46uNOTp_OOYtWri21l5wyuCEueOliu9aZo0kQFr7Z3VRChqhz-UP9WBzs-ZlS1A2tr-qCu2FaAVieOEc7NXPyBy20ZFhM Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Domain-Id: None Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Domain-Name: None Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Identity-Status: Confirmed Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Is-Admin-Project: True Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Domain-Id: default Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Domain-Name: Default Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Project-Name: admin Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Role: admin,reader,member Jun 20 05:57:35.395863 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Roles: admin,reader,member Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f271df74ec2467682bcd9230f451749"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f271df74ec2467682bcd9230f451749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f271df74ec2467682bcd9230f451749", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant: admin Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant-Id: 5f271df74ec2467682bcd9230f451749 Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-Tenant-Name: admin Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User: admin Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Domain-Id: default Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Domain-Name: Default Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Id: 03c25f17f05341ab8190ac8b2fc040ce Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: X-User-Name: admin Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: method: > Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: exception: Flavor 451 could not be found. Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: action_args: {'id': '451'} Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 05:57:35.397218 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:35.398094 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: ERROR nova.api.openstack.wsgi Jun 20 05:57:35.399184 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-d4dc3ab9-d516-4f98-8384-67365d1ba9e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 05:57:35.400152 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-d4dc3ab9-d516-4f98-8384-67365d1ba9e4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012645 Jun 20 05:57:35.400152 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 20 05:57:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 05:57:36.211807 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:36.212815 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 20 05:57:36.213237 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:36.400110 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-768b8ba8-2269-4783-91c7-f3878209fed9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:36.417983 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-768b8ba8-2269-4783-91c7-f3878209fed9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068387 Jun 20 05:57:36.418532 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 20 05:57:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:37.233913 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:37.234914 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 20 05:57:37.235308 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:37.422870 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-cc6b6360-4482-46ef-a645-db0dc570c3f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:37.441182 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-cc6b6360-4482-46ef-a645-db0dc570c3f9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069353 Jun 20 05:57:37.441719 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 20 05:57:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:38.265497 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:38.266763 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 20 05:57:38.267154 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:38.460707 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-eee9fa13-4e07-4dde-96ed-8a826db956f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:38.477970 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-eee9fa13-4e07-4dde-96ed-8a826db956f4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068613 Jun 20 05:57:38.478511 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 20 05:57:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:39.293257 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:39.294295 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 20 05:57:39.294694 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:39.485074 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-0332e2c3-f79d-410f-aba9-854c63dfea49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 05:57:39.503389 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-0332e2c3-f79d-410f-aba9-854c63dfea49 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068807 Jun 20 05:57:39.503923 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 20 05:57:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:40.321354 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:40.322366 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 20 05:57:40.322771 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 05:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:57:40.509350 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-b81a9a90-2496-49fd-8505-f1beb4a06e43 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:57:40.528349 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-b81a9a90-2496-49fd-8505-f1beb4a06e43 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069561 Jun 20 05:57:40.528881 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Jun 20 05:57:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:58:27.088537 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:58:27.089591 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-efd5e073-94b2-466e-8f17-8964226ddf83 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 20 05:58:27.089996 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 20 05:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 05:58:27.100678 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.149541 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-2fa36248-b22d-4f6b-a824-988d311e9875 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:58:27.168722 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-2fa36248-b22d-4f6b-a824-988d311e9875 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072561 Jun 20 05:58:27.169291 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 20 05:58:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 05:58:27.192457 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-cf2017fd-49eb-4b71-a05b-562db7e8d420 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:58:27.195880 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=14 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.201701 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-cf2017fd-49eb-4b71-a05b-562db7e8d420 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012778 Jun 20 05:58:27.202259 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jun 20 05:58:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:27.213438 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-ea04be9a-ebb4-4a9a-b2a2-c06d615e67d0 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:58:27.221462 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-ea04be9a-ebb4-4a9a-b2a2-c06d615e67d0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011587 Jun 20 05:58:27.221978 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jun 20 05:58:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:27.232908 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:58:27.240894 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011376 Jun 20 05:58:27.241444 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jun 20 05:58:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:27.251992 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-58329442-9397-4e8d-8b1b-03afa1668d05 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 05:58:27.259429 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-58329442-9397-4e8d-8b1b-03afa1668d05 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010780 Jun 20 05:58:27.259937 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jun 20 05:58:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:01:39.904711 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:39.905740 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jun 20 06:01:39.906168 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 06:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:01:40.045763 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_api:SELECT=6 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:40.158607 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-b8d8e6ca-c547-4e7a-b8c4-cfbed46df799 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:40.159755 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:01:40.159755 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: warnings.warn(msg) Jun 20 06:01:40.160937 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-b8d8e6ca-c547-4e7a-b8c4-cfbed46df799 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:40.161392 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-b8d8e6ca-c547-4e7a-b8c4-cfbed46df799 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:40.162169 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-b8d8e6ca-c547-4e7a-b8c4-cfbed46df799 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:40.162588 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-b8d8e6ca-c547-4e7a-b8c4-cfbed46df799 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:40.195885 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-b8d8e6ca-c547-4e7a-b8c4-cfbed46df799 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.151630 Jun 20 06:01:40.196427 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 20 06:01:40 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:41.016338 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:41.017366 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jun 20 06:01:41.017756 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 06:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:01:41.218896 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-ab3a0af1-effb-4e82-8551-f1ed9b403912 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:41.220067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:01:41.220067 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: warnings.warn(msg) Jun 20 06:01:41.221316 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-ab3a0af1-effb-4e82-8551-f1ed9b403912 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:41.221754 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-ab3a0af1-effb-4e82-8551-f1ed9b403912 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:41.222533 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-ab3a0af1-effb-4e82-8551-f1ed9b403912 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:41.222955 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-ab3a0af1-effb-4e82-8551-f1ed9b403912 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:41.242499 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-ab3a0af1-effb-4e82-8551-f1ed9b403912 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.086065 Jun 20 06:01:41.242975 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 20 06:01:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:52.493725 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:52.493725 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 20 06:01:52.494746 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 06:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:01:52.637115 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_cell0:SELECT=4 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:52.637834 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_cell1:SELECT=4 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:52.639026 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG dbcounter [-] [103302] Writing DB stats nova_api:SELECT=8 {{(pid=103302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:52.686613 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-3e326062-b617-482c-b7aa-e650b928b499 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:52.687838 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:01:52.687838 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: warnings.warn(msg) Jun 20 06:01:52.689031 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-3e326062-b617-482c-b7aa-e650b928b499 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:52.689467 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-3e326062-b617-482c-b7aa-e650b928b499 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:52.690318 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-3e326062-b617-482c-b7aa-e650b928b499 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:52.690747 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-3e326062-b617-482c-b7aa-e650b928b499 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:52.715432 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-3e326062-b617-482c-b7aa-e650b928b499 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082721 Jun 20 06:01:52.715903 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 20 06:01:52 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:01:53.535672 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:53.536677 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1a0ba9ae-b32e-4519-8fcf-5e039ba1dcdc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 20 06:01:53.537104 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 20 06:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:01:53.728962 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG nova.api.openstack.wsgi [None req-5f6ec35b-d941-4d8b-93e6-132fb5464a49 admin admin] Calling method '>' {{(pid=103302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:01:53.730173 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:01:53.730173 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: warnings.warn(msg) Jun 20 06:01:53.731544 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-5f6ec35b-d941-4d8b-93e6-132fb5464a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:53.732728 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-5f6ec35b-d941-4d8b-93e6-132fb5464a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:53.733536 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-5f6ec35b-d941-4d8b-93e6-132fb5464a49 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:01:53.733959 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: DEBUG oslo_concurrency.lockutils [None req-5f6ec35b-d941-4d8b-93e6-132fb5464a49 admin admin] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:01:53.755619 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: INFO nova.api.openstack.requestlog [None req-5f6ec35b-d941-4d8b-93e6-132fb5464a49 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080003 Jun 20 06:01:53.756158 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: [pid: 103302|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 20 06:01:53 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:02:50.020311 dv-cinder-836996-36-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 06:02:50.020824 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: Mon Jun 20 06:02:50 2022 - graceful shutdown triggered... Jun 20 06:02:50.021302 dv-cinder-836996-36-iscsi devstack@n-api.service[103302]: Gracefully killing worker 2 (pid: 103302)... Jun 20 06:02:50.021720 dv-cinder-836996-36-iscsi devstack@n-api.service[103301]: Gracefully killing worker 1 (pid: 103301)... Jun 20 06:02:51.021921 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: worker 1 buried after 1 seconds Jun 20 06:02:51.022481 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: worker 2 buried after 1 seconds Jun 20 06:02:51.022481 dv-cinder-836996-36-iscsi devstack@n-api.service[103300]: goodbye to uWSGI. Jun 20 06:02:51.023490 dv-cinder-836996-36-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 06:02:51.024035 dv-cinder-836996-36-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 06:02:51.026937 dv-cinder-836996-36-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 06:02:51.036871 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 06:02:51 2022] *** Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: nodename: dv-cinder-836996-36-iscsi Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: machine: x86_64 Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: clock source: unix Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: pcre jit disabled Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: detected number of CPU cores: 4 Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: current working directory: / Jun 20 06:02:51.038883 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: detected binary path: /usr/bin/uwsgi-core Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: your processes number limit is 47680 Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: your memory page size is 4096 bytes Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: detected max file descriptor number: 2048 Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: lock engine: pthread robust mutexes Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: thunder lock: enabled Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 06:02:51.039627 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 06:02:51.085177 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: Python main interpreter initialized at 0x560b10e239c0 Jun 20 06:02:51.085177 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: python threads support enabled Jun 20 06:02:51.085177 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: your server socket listen backlog is limited to 100 connections Jun 20 06:02:51.085177 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: your mercy for graceful operations on workers is 90 seconds Jun 20 06:02:51.085597 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 06:02:51.085680 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: *** Operational MODE: preforking *** Jun 20 06:02:51.085929 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: *** uWSGI is running in multiple interpreter mode *** Jun 20 06:02:51.085929 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: spawned uWSGI master process (pid: 117649) Jun 20 06:02:51.086133 dv-cinder-836996-36-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 06:02:51.088776 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: spawned uWSGI worker 1 (pid: 117665, cores: 1) Jun 20 06:02:51.089157 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: spawned uWSGI worker 2 (pid: 117666, cores: 1) Jun 20 06:02:51.089312 dv-cinder-836996-36-iscsi devstack@n-api.service[117649]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 06:02:51.747060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:02:51.767787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:02:52.948374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:52.948374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: from cryptography.utils import int_from_bytes Jun 20 06:02:52.949808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:52.949808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: from cryptography.utils import int_from_bytes Jun 20 06:02:52.996730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:52.996730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: from cryptography.utils import int_from_bytes Jun 20 06:02:52.997363 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:52.997363 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: from cryptography.utils import int_from_bytes Jun 20 06:02:55.375398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:02:55.375950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:02:55.376230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:02:55.376507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:02:55.376769 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:02:55.377196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.377534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.377864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.378193 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.378532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.378848 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.379179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.379506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.379840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.380106 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.380427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.380758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-36-iscsi {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.381114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.381431 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.381752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.382078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.382389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.382718 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.383032 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.383540 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.385026 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.385026 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.385026 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.385308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.385623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.385930 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.386268 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.387129 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.387454 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.387765 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.388187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-36-iscsi {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.388504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.388826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.389243 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.389677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.389990 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.390301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.390626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.390965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.391278 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.391615 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.391943 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.392267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.392591 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.392899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.393258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.393564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.393889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.394194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.394502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.395013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.395324 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.395648 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.395973 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.396297 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.396552 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.396807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.397155 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.397481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.397796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.398114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.398423 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.398735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.399046 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.399353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.399662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.399972 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.400298 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.400620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.400947 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.401286 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.401612 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.402065 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.402855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.403174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.403525 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.403852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.404162 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.404485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.404808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.405152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.405468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.405779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.406103 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.406445 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.406754 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.407009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.407316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.407633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.407957 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.408279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.408586 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.408897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.409242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.409553 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.409865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.410175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.410487 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.410799 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.411110 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.411422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.411731 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.412039 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.412368 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.412692 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.413040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.413347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.413659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.413969 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.414495 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.414802 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.415116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.415448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.415761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.416073 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.416397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.416712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.417055 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.417384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.417727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.418046 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.418366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.418682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.418990 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.419299 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.419605 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.419911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.420219 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.420524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.420829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.421159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.421483 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.421807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.422121 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.422430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.422737 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.423061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.423485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.423796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.424092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.424489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.424737 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.425113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.425439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.425758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.426078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.426411 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.426728 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.427044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.427358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.427681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.428008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.428439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.428659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.429022 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.429329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.429662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.429961 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.430297 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.430626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.430941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.431287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.431635 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.431953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.432282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.432612 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.432928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.433294 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.433628 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.433936 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.434272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.434647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.434906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.435224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.435538 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.435852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.436165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.436479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.436810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.437580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.437580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.437896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.438091 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.438409 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.438730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.439042 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.439355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.439542 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:02:55.440059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.440222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:02:55.440378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.440378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.440668 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:02:55.440821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.440965 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:02:55.441135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.441290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:02:55.441442 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.441593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.441760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.441904 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.442054 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.442203 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.442353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.442509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.442661 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.442803 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.442952 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.443102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.443245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.443395 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.443545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.443731 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.443887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.444052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.444204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.444381 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.444534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.444720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.444867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.445036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-36-iscsi {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.445198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.446157 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.446314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.446459 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.446613 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.446764 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.446926 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.447081 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.447232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.447232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.447518 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.447661 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.447815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.447959 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.448330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.448482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.448482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.448773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.449475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.449714 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.449869 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.450058 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.450218 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.450372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.450523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.450672 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.450821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.451000 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.451287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.451470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.451616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.451758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.451907 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.452057 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.452213 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.452367 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.452509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.452658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.452807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.452963 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-36-iscsi {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.453251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.453396 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.453545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.453687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.453828 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.453986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.454137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.454137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.454412 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.454556 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.454704 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.454859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.455001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.455153 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.455302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.455482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.456082 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.456321 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.456474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.456619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.456768 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.456927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.457107 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.457755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.457856 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.457940 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.458020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458090 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.458173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458254 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.458328 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.458472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458611 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.458687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458777 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.458866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.458866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.459034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.459116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.459196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.459275 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.459360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.459447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.459537 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.459619 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.459713 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.459809 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.459893 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.459972 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.460060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.460153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.460241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.460329 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.460418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.460586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.460768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.460933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.461149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.461305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.461450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.461591 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.461759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.461912 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.462056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.462205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.462348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.462526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.462682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.462835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.462979 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.463120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.463273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.463416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.463582 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.463734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.463879 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.464029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.464172 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.464324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.464481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.465323 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.465493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.465646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.466281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.466434 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.466588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.466743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.466895 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.467039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.467181 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.467370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.467519 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.467661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.467810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.467953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.468103 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.468258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.468402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.468550 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.468719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.468871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.469131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.469295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.469448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.469605 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.469749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.469890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.470059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.470304 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.470452 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.470613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.470758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.470916 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.471069 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.471218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.471371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.471519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.471669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.471818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.471971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.472121 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.472262 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.472403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.472545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.472702 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.472854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.473043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.473193 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.473347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.473489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.473637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.473793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.473934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.474076 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.474216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.474365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.474521 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.474673 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.474821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.475098 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.475263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.475417 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.475574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.475725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.475893 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.476561 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.476733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.476881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.477064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.477223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.477388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.477542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.477703 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.477847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.477995 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.478138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.478279 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.478434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.478586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.478730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.478871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.479021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.479178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.479427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.479574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.479726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.479875 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.480019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.480175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.480347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.480583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.480732 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.480881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.481062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.481231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.481376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.481528 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.481677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.481820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.481970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.482183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.482327 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.482467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.482608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.482749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.482905 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.483061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.483205 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.483356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.483504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.483646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.483796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.483945 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.484095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.484237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.484385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.484534 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.484689 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.484831 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.485057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.485207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.485371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.485569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.485725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.485867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.486010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.486632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.486793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.486945 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:55.487099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.487242 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.487391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.487533 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.487779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.487952 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.487952 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.488242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.488384 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.488542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.488542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.488821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.489057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.489212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.489355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.489610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.489767 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.489936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.490086 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.490232 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.490232 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.490500 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.490649 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.490817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491813 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.491973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492695 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.492998 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.493163 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.493308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.493457 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.493599 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.493750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.493916 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494066 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494808 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.494950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.495097 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.495246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.495388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.495537 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.495692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.496788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.496942 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.497136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.497414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.497581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.497736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.497888 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498189 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498337 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.498935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.499079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.499220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.499374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.499374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.499752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.499912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500208 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500508 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500802 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.500943 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.501208 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.501366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.501517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.501668 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.501810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.501950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502242 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502532 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502674 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.502985 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.503134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.503283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.503425 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.503574 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.503716 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.503866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504009 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.504924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.505112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.505400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.505557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.505557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.505862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.506021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.506176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.506325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.506902 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.507076 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.507245 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.507406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.507565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.507716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.507864 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508022 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508179 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508492 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508797 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.508958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.509145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.509313 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.509470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.509620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.509798 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.510049 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.510789 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.510961 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.511122 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.511391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.512154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.512303 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.512476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.512699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.512844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513038 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513695 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513846 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.513997 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.514147 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.514307 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.514460 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.514615 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.514764 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.514915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.515057 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.515198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.515348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.515598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.515746 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.515896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.516044 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.516187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.516342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.517493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.517493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.517812 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.517956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518111 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.518979 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.519121 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.519268 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.519429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.519828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.519984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.520264 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.520421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.520565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.520706 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.520855 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.521016 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.521178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.521321 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.521481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.521750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.521926 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.522087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.522244 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.522401 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.522551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.522701 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.522848 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.523011 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.523161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.523317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.523696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.523850 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.523998 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.524174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.524324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.524481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.524630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.524969 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.525164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.525339 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.525509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.525753 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.525913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.526071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.526234 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.526392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.526552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.526719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.527867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.528027 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.528187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.528345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.528495 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.528643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.528807 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529238 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529696 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529696 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.529997 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.530157 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.530413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.530570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.530719 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.530867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.531026 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.531185 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.531341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.531490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.531655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.531921 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.532090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.532242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.532390 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.532577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.532577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.532863 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533041 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533198 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.533982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.534141 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.534298 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.534447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.534595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.534752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.534903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535199 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.535999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.536155 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.536304 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.536459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.536621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.536778 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.537133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.537363 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.537519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.537805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.537982 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.538133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.538300 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.538452 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.538608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.538772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.538922 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.539070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.539218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.539374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.539531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.539695 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.539852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.540002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.540180 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.540331 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.540592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.540800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.540958 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.541186 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.541348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.541499 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.541648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.541810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.542067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.542224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.542380 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.542543 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.542757 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.543431 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.543591 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.543748 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.543897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544668 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.544998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.545187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.545345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.545494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.545641 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.545791 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.545791 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.546081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.546231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.546387 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.546536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.546692 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.546855 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.547024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.547266 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.547554 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.547715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548522 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.548999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.549260 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.549427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.549585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.549759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.549910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.550066 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.550066 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.550363 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.550520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.550769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.550927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.551237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.551419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.551580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.551730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.551896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.552067 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.552321 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.552476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.552626 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.552774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.552922 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.553107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.553272 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.553423 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.553571 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.553727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.553876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554199 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554645 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554800 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.554958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.555126 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.555310 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.555511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.555668 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.555825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.555994 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.556157 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.556305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.556452 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.556600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.556756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.557047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.557206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.557379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.557379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.557772 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.558063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.558240 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.558436 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.558436 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.558721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.558869 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559344 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.559969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.560138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.560297 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.560466 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.560616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.560616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.561057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.561250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.561411 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.561573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.561731 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.561888 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.562045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.562503 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.562687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.562847 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563781 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.563931 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.564078 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.564234 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.564390 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.564548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.564710 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.564867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.565081 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.565238 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.565398 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.565561 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.565712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.565868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566024 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.566964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.567113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.567269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.567471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.567652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.567898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.568073 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.568358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.568620 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.568790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.568940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.569115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.569276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.569439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.569598 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.569749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.569749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.570042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.570191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.570358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.570522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.570747 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.570910 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.571088 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.571824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.572387 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.572664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.572832 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.573013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.573187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.573339 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.573487 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.573650 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.574195 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.574746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.574899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.575077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.575346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.575546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.575700 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.575858 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.576376 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.576933 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577128 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577234 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577323 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577612 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.577953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578119 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578210 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578289 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578367 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578514 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.578951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579549 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579685 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579759 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579828 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579908 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.579990 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580078 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580240 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580411 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580491 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580571 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580650 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580837 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.580927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581131 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581303 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581383 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581553 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581809 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581885 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.581953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582211 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582741 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582811 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.582980 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583067 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583574 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583756 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583845 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.583927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584271 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584534 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584714 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584804 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.584893 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585004 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585913 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.585994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586165 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586368 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586701 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586780 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586859 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.586946 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587028 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587453 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587621 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587699 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.587935 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588774 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.588933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.589256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.589355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.589447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590098 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590246 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590344 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590684 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.590947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591109 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591627 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591715 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591806 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.591969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592191 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592684 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592767 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.592945 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.593086 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.593364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.593470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.593670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.593771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.593988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.594079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.594296 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.594395 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.594607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.594712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.594918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595547 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595645 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.595949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.596167 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.596257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.596475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.596566 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.596790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.596895 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.597126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.597226 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.597437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.597535 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.597790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.597887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.598119 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.598385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.598543 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.598723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.598815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599034 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599292 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599396 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599495 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599740 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.599967 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.600062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.600275 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.600372 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.600602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.600693 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.600932 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.601057 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.601354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.601497 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.601667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.601841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.602092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.602188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.602409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.602508 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.602726 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.602855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.603061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.603152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.603391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.603482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.603723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.603818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.604034 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.604131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.604356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.604447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.604671 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.604768 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.605004 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.605114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.605870 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.605976 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.606191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.606281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.606510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.606662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.606821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.606911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.607134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.607221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.607451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.607542 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.607765 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.607902 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.608081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.608170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.608396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.608494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.608712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.608808 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.609058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.609164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.609410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.609513 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.609733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.609831 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.610058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.610147 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.610380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.610477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.610705 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.610808 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611738 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.611955 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.612057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.612273 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.612363 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.612594 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.612684 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.612913 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.613079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.613251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.613390 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.613562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.613772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.613943 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.614092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.614187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.614416 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.614512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.614741 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.614839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.615059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.615156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.615387 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.615475 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.615715 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.615825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.616035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.616132 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.616361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.616450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.616674 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.616775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617414 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617678 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.617994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.618085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.618304 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.618438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.618616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.618713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.618930 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619244 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619569 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619879 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.619968 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.620186 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.620290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.620494 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.620592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.620827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.620923 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.621161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.621268 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.621469 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.621567 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.621777 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.621867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.622084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.622187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.622394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.622528 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.622701 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.622819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623140 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623403 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623618 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623709 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.623923 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624326 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624627 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624842 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.624933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.625174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.625266 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.625524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.625629 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.625785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.625883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.626089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.626178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.626424 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.626515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.626732 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.626822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.627066 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.627154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.627388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.627490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.627698 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.627786 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628110 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628437 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.628999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.629103 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.629324 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.629413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.629680 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.629783 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.629962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630678 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.630999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.631215 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.631306 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.631527 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.631617 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.631841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.631936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.632160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.632257 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.632489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.632712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.632811 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.633084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.633192 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.633413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.633503 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.633738 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.633838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.634062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.634162 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.634383 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.634479 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.634705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.634802 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635112 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635339 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635435 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635751 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.635968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.636058 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.636283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.636379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.636627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.636723 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.636950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.637085 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.637304 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.637395 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.637636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.637734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.637953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.638051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.638283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.638399 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.638612 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.638736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.638967 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.639102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.639287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.639429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.639634 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.639867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.639955 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.640046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.640273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.640370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.640589 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.640680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.640899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.641008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.641181 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:02:55.641312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.641638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.641961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.642283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.642601 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.642929 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.643252 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.643582 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.643925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.644255 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.644830 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.645256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.645585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.646113 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.646441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.646783 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.647119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.647453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.647779 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.648103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.648437 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.648755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.649091 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.649411 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.649730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.650042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.650372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.650691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.651006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.651329 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.651645 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.652715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.653096 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.653421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.653758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.654094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.654421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.654737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.655070 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.655383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.655698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.656022 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.656342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.656652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.656964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.657302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.657618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.657931 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.658250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.658561 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.658896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.659210 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.659523 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.659834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.660154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.660468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.660780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.661119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.661445 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.661793 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.662147 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.662480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.662801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.663122 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.663435 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.663753 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.666991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.667364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.668508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.668855 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.669211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.669559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.669903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.670222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.670536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.670851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.671186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.671504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.671824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.672178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.672527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.672891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.673254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.673593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.673910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.674231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.674548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.674865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.675185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.675498 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.675822 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.676170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.676499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.676827 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.677179 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.677508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.677827 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.678146 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.678462 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.678780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.679101 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.679440 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.679760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.680072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.680586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.680907 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.681262 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.681590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.681910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.682240 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.682571 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.682896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.683225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.683697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.683895 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.684241 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.684579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.684908 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.685245 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.685556 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.685868 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.686185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.686509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.686825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.687134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.687442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.687757 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.688066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.688376 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.688688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.689015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.689336 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.689642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.689952 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.690262 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.690570 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.690876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.691183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.691500 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.691806 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.692114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.692423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.692735 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.693064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.693403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.693742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.694062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.694390 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.694714 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.695032 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.695348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.695675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.696001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.696320 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.696636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.697001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.697309 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.697634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.697947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.698265 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.698578 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.698993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.699524 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.699865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.700181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.700513 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.700840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.701189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.701513 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.701833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.702169 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.702489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.702812 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.703133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.703452 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.703769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.704092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.704416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.704625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Registered counter for database nova_api Jun 20 06:02:55.704835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.705105 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.705427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.705763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.706096 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.706448 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.706769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.707121 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.707454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.707776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.709569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.709569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:55.709569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:02:55.725180 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.732321 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:55.773201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Registered counter for database nova_api Jun 20 06:02:55.787895 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.context [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40624e2c-0e91-4c97-b143-ade440b678f9(cell1) {{(pid=117666) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:02:55.792002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:55.794205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.794325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:55.795036 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:55.797023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:55.799051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Registered counter for database nova_cell0 Jun 20 06:02:55.801129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:55.803128 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Registered counter for database nova_cell1 Jun 20 06:02:55.809963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.811650 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.817569 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:55.819167 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:55.858773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.context [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40624e2c-0e91-4c97-b143-ade440b678f9(cell1) {{(pid=117665) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:02:55.862933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:55.864606 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:55.865485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:55.867455 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:55.869950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Registered counter for database nova_cell0 Jun 20 06:02:55.874718 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Registered counter for database nova_cell1 Jun 20 06:02:55.882269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.884582 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.890202 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:55.895843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:55.967048 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Registered counter for database nova_cell0 Jun 20 06:02:55.973914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:55.978690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:56.044039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Registered counter for database nova_cell0 Jun 20 06:02:56.050866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:56.055660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:56.298169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:56.305517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:56.385186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:56.393179 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:56.647206 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:56.653971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-04297029-c365-4e02-a5ef-1be57415d60b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:56.659418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560b10e239c0 pid: 117666 (default app) Jun 20 06:02:56.735359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:56.741389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-e3872031-8138-4e6b-aaf6-5372750a8fbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:56.746719 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560b10e239c0 pid: 117665 (default app) Jun 20 06:03:37.158362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-49e30b00-ed73-44fb-9d62-a8e2bf6d4872 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d4623a280>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:37.199584 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.201908 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.204496 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.206501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.230617 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.234739 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.236681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.239340 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.931406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-49e30b00-ed73-44fb-9d62-a8e2bf6d4872 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f6a8120d-e30d-47ef-a19e-6c9da77f459c" status: 200 len: 351 microversion: 2.1 time: 1.021558 Jun 20 06:03:37.932228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:36 2022] GET /compute/v2.1/os-volumes/f6a8120d-e30d-47ef-a19e-6c9da77f459c => generated 351 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:38.092348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9f3e488e-a5f8-4727-b3a0-2d9ae0c6d4eb tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Action: 'create', calling method: .version_select at 0x7f9d46187700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1203725701", "metadata": {"Type": "work"}}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:39.178072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9f3e488e-a5f8-4727-b3a0-2d9ae0c6d4eb tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.966150 Jun 20 06:03:39.179771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 20 06:03:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1970 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 06:03:39.192283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5f8d8c04-1d87-432d-9448-b21efe99a42b tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Calling method '.version_select at 0x7f9d4608d5e0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:39.269077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5f8d8c04-1d87-432d-9448-b21efe99a42b tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b" status: 200 len: 353 microversion: 2.1 time: 0.081023 Jun 20 06:03:39.270427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:39 2022] GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:39.741222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1f58aa27-2bed-4316-9bb1-ae2f50e646ac tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d4604e550>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:39.872617 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1f58aa27-2bed-4316-9bb1-ae2f50e646ac tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/acb14001-963d-4358-a2c0-e67788d942ec" status: 200 len: 351 microversion: 2.1 time: 0.135788 Jun 20 06:03:39.874345 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:39 2022] GET /compute/v2.1/os-volumes/acb14001-963d-4358-a2c0-e67788d942ec => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:40.283402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-79302286-b6e9-4fa6-942d-d9814c69d298 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Calling method '.version_select at 0x7f9d4608d550>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:40.396271 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-79302286-b6e9-4fa6-942d-d9814c69d298 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b" status: 200 len: 354 microversion: 2.1 time: 0.116812 Jun 20 06:03:40.396843 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:40 2022] GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:40.407851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cd497e7d-cf0a-415d-9a2c-a08712c20022 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Calling method '.version_select at 0x7f9d4604e790>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:40.541240 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cd497e7d-cf0a-415d-9a2c-a08712c20022 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b" status: 200 len: 354 microversion: 2.1 time: 0.137278 Jun 20 06:03:40.542186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:40 2022] GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:40.561534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3563d08b-45ab-4f2a-9e6c-34d46573af36 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Calling method '.version_select at 0x7f9d4608ddc0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:40.693092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3563d08b-45ab-4f2a-9e6c-34d46573af36 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b" status: 202 len: 0 microversion: 2.1 time: 0.138969 Jun 20 06:03:40.693720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:03:40 2022] DELETE /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:03:40.703344 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-19350a42-3218-4843-a6e8-f50823767f85 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Calling method '.version_select at 0x7f9d4604edc0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:40.789350 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-19350a42-3218-4843-a6e8-f50823767f85 tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b" status: 200 len: 353 microversion: 2.1 time: 0.089684 Jun 20 06:03:40.795080 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:40 2022] GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:41.578538 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-38f6748e-d1b0-4195-8422-d9219b1f22dd tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d460494c0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:41.665867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-38f6748e-d1b0-4195-8422-d9219b1f22dd tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/31500f6a-443b-446b-8cd1-fd3c7cc3602c" status: 200 len: 351 microversion: 2.1 time: 0.091745 Jun 20 06:03:41.667709 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:41 2022] GET /compute/v2.1/os-volumes/31500f6a-443b-446b-8cd1-fd3c7cc3602c => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:41.683431 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9dfc187e-394d-4780-b4a4-e316b2840207 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d45fe8430>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:41.805345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c5198f73-caed-4e4a-8ad8-428edfd3d62d tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Calling method '.version_select at 0x7f9d4608dca0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:41.853710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-c5198f73-caed-4e4a-8ad8-428edfd3d62d tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] HTTP exception thrown: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c5198f73-caed-4e4a-8ad8-428edfd3d62d tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Request method failure captured: Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b HTTP/1.1 Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA25vBell0Jqo5oP18gQUmn-AUePOwdan8mK4CX2p_S15F15BUsvGEx02H-lNIC4Bdk3brdxW4JOFf-VJFwACvfWY-tW5-x35jSihXIXcq7oweF_TSjOk6sLuISDMaZrRtPnaNLzHFu7oXeJFNGzrnpFFF4HfeaDp5A2JiZWxE_E2ww Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 02efd17f3a094447a51c5d4b0a6dd11b Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesGetTestJSON-1016809721 Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:03:41.858840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02efd17f3a094447a51c5d4b0a6dd11b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02efd17f3a094447a51c5d4b0a6dd11b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02efd17f3a094447a51c5d4b0a6dd11b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02efd17f3a094447a51c5d4b0a6dd11b", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesGetTestJSON-1016809721 Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 02efd17f3a094447a51c5d4b0a6dd11b Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesGetTestJSON-1016809721 Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesGetTestJSON-1016809721-project Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 4fcbd7bf4548436a91096e6e36693266 Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesGetTestJSON-1016809721-project Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'ab3f2437-218a-446c-af09-8d2bf0998e3b'} Jun 20 06:03:41.860261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. (HTTP 404) (Request-ID: req-63b2aa70-b178-4118-8ca2-f3b729405f95) Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:03:41.861116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:03:41.865862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:03:41.867087 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c5198f73-caed-4e4a-8ad8-428edfd3d62d tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] Returning 404 to user: Volume ab3f2437-218a-446c-af09-8d2bf0998e3b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c5198f73-caed-4e4a-8ad8-428edfd3d62d tempest-VolumesGetTestJSON-1016809721 tempest-VolumesGetTestJSON-1016809721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b" status: 404 len: 109 microversion: 2.1 time: 0.061020 Jun 20 06:03:41.868200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:03:41 2022] GET /compute/v2.1/os-volumes/ab3f2437-218a-446c-af09-8d2bf0998e3b => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:03:42.084229 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9dfc187e-394d-4780-b4a4-e316b2840207 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.407934 Jun 20 06:03:42.086982 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jun 20 06:03:41 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:03:42.104770 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f94744b1-fb78-4d8c-8e29-7beee778778d tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d469b0c10>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:42.453212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f94744b1-fb78-4d8c-8e29-7beee778778d tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.357535 Jun 20 06:03:42.456227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Jun 20 06:03:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:42.469499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bd446bb9-0af2-4c43-ae02-be1337e16ffd tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d4604edc0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:42.645246 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bd446bb9-0af2-4c43-ae02-be1337e16ffd tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.180207 Jun 20 06:03:42.646268 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jun 20 06:03:42 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:42.658734 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d612f66e-7f94-4f36-97b1-b4a497d8aacd tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d45fba3a0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:42.867498 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d612f66e-7f94-4f36-97b1-b4a497d8aacd tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.213610 Jun 20 06:03:42.868298 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1166 bytes} [Mon Jun 20 06:03:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:42.881773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c4baa39b-7fa0-4747-b49f-27e724215788 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d45fe8b80>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:43.007890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c4baa39b-7fa0-4747-b49f-27e724215788 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.131042 Jun 20 06:03:43.008852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Jun 20 06:03:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:43.021610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0220b2c1-daf6-4be2-a0d1-bb6ac39d5aba tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d45fc0040>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:43.132062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0220b2c1-daf6-4be2-a0d1-bb6ac39d5aba tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.114634 Jun 20 06:03:43.132868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jun 20 06:03:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:43.145140 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-55b82b50-30a2-42d9-ac8c-8907898c9e55 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d45fee040>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:43.300359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-55b82b50-30a2-42d9-ac8c-8907898c9e55 tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.159708 Jun 20 06:03:43.301079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1187 bytes} [Mon Jun 20 06:03:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:03:43.319637 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-026124d1-1fda-4591-b90a-cb24a691f38f tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] Calling method '.version_select at 0x7f9d460494c0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:43.465637 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-026124d1-1fda-4591-b90a-cb24a691f38f tempest-VolumesTestJSON-1388264593 tempest-VolumesTestJSON-1388264593-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.156516 Jun 20 06:03:43.466338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jun 20 06:03:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:52.918328 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8957afd9-dc1d-4a1f-971b-b17f6b1d14b1 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: .version_select at 0x7f9d4604e820>, body: {"keypair": {"name": "tempest-keypair-1716686664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj2+EKSzlHn0O6/A0i806uhhhkxf9Eoakd6bq6x4FMxpOR+G6sDVcOxN1REYukTp7llgm2YAvii1/dz63zw2PkQnZT3S8csRdbGReyXP3dgb0xtaHV0d1BuHQHKSLIATQ=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:53.085969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-8957afd9-dc1d-4a1f-971b-b17f6b1d14b1 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:03:53.115089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-8957afd9-dc1d-4a1f-971b-b17f6b1d14b1 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for user a8fcbdaedda84e74b7b2c78415e71d9c and project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:03:53.263739 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8957afd9-dc1d-4a1f-971b-b17f6b1d14b1 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.613226 Jun 20 06:03:53.264613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 9/19] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:03:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:56.719288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1600431062", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:57.032541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] validate_networks() for [('2c78fcbc-665a-466f-b9ff-c9c04fb72740', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:03:57.405079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-83300382", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "networks": [{"uuid": "76808cca-c752-4ccc-8426-14e19cd597b7"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:57.616265 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] validate_networks() for [('76808cca-c752-4ccc-8426-14e19cd597b7', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:03:59.942648 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:03:59.943107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:03:59.943774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:03:59.944448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:03:59.945875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:03:59.997621 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:03:59.999108 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:00.003738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:00.004360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:00.139220 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:04:00.182037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for user 0db0333f0ea245539f27e0d8f27daca3 and project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:04:00.224354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:04:00.236624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:04:00.356579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:04:00.357185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:04:00.357516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:04:00.358131 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:04:00.358727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:04:00.382251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:00.383002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:00.384066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:00.385422 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:00.442454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Getting quotas for project f7f3449a9b4040b9ac30f285b7b13e38. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:04:00.448709 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Getting quotas for user 2836ce30f99f4a5ab66bea1553a2b038 and project f7f3449a9b4040b9ac30f285b7b13e38. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:04:00.464633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2324e380-ea6c-4223-8df7-3a47dfd26a4c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.280060 Jun 20 06:04:00.465502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:03:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:04:00.478497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:04:00.482654 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:04:00.633551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bb9fbbbb-d168-45cf-a6f1-d760b7933ea6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.676801 Jun 20 06:04:00.640916 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 10/21] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:04:00.654454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-31cd11f5-2719-4bf4-93c9-0a416009c877 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:00.658388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-31cd11f5-2719-4bf4-93c9-0a416009c877 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:00.913265 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-31cd11f5-2719-4bf4-93c9-0a416009c877 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:00.935815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-31cd11f5-2719-4bf4-93c9-0a416009c877 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1222 microversion: 2.1 time: 0.293181 Jun 20 06:04:00.943850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:00 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1222 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:00.972563 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dea0b989-f358-441a-9d5b-a75c5d81707c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:00.973781 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dea0b989-f358-441a-9d5b-a75c5d81707c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:01.117719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0012a72b-4bd9-401a-836d-ee826d0f63c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'create', calling method: .version_select at 0x7f9d456c4160>, body: {"keypair": {"name": "tempest-keypair-230665252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaeeUl8HnKUp5L8pYQtCYdETKBGsYCEnQdeiLOsdmVHBv7+AvCTYPRsSGZuDkqJy7epwBKJP17WSfw6llNPSXnvc4Y6NP9MDkz0mFEBI8WrYbxSBzBx/YfT1vD1dhEqqA=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:01.175379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-0012a72b-4bd9-401a-836d-ee826d0f63c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for project ce606b9c1e514773a7201b9e83a8af69. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:04:01.175717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dea0b989-f358-441a-9d5b-a75c5d81707c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:01.187011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dea0b989-f358-441a-9d5b-a75c5d81707c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1213 microversion: 2.1 time: 0.237656 Jun 20 06:04:01.190033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:00 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1213 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:01.191563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-0012a72b-4bd9-401a-836d-ee826d0f63c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for user 715da00088754d0e8c6ecfa5a2c9b50c and project ce606b9c1e514773a7201b9e83a8af69. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:04:01.310572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0012a72b-4bd9-401a-836d-ee826d0f63c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.841489 Jun 20 06:04:01.312646 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 12/24] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Jun 20 06:04:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 846 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 06:04:01.957037 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1563952668", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:02.095996 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] validate_networks() for [('2c78fcbc-665a-466f-b9ff-c9c04fb72740', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:04:02.192728 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1711102797", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "deefef70-5b87-4a75-bdf1-b7756b040d57"}], "security_groups": [{"name": "tempest-securitygroup--1117306209"}], "key_name": "tempest-keypair-1716686664", "user_data": "}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:02.851599 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] validate_networks() for [('deefef70-5b87-4a75-bdf1-b7756b040d57', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:04:04.747460 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:04:04.748023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:04:04.750362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:04:04.750846 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:04:04.751393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:04:04.771128 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:04.772882 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:04.776031 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:04.776816 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:04.797564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:04:04.802072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for user 0db0333f0ea245539f27e0d8f27daca3 and project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:04:04.814830 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:04:04.817156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:04:04.866763 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:04:04.868203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:04:04.868809 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:04:04.871029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:04:04.874511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:04:04.888322 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6a7efeb6-f8a0-4d9a-91f0-a851a3d7cd0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.938444 Jun 20 06:04:04.893008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 13/25] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:04:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:04:04.907899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:04.910594 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:04.915279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:04.916168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:04.919167 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:04.920248 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:04.924132 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:04.924597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:04.925421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:04.925874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:04.950130 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:04:04.974015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for user a8fcbdaedda84e74b7b2c78415e71d9c and project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:04:05.020523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:04:05.025138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:04:05.152780 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce6413ae-c1ca-45cd-b0e4-a8b4744af435 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.965022 Jun 20 06:04:05.158854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 13/26] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:04:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:04:05.167411 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-307903ec-86d7-4755-807f-d261ed634ebe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:05.169246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-307903ec-86d7-4755-807f-d261ed634ebe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:05.318949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:05.358056 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e0c85df0-e4dd-4411-9326-8bbae1599043 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1265 microversion: 2.1 time: 0.463559 Jun 20 06:04:05.372065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:04 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1265 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:05.388688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2003757233", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ea7947d-6cbe-4d2d-93eb-f19499429cea"}], "security_groups": [{"name": "tempest-securitygroup--1539475531"}], "key_name": "tempest-keypair-230665252", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:05.444252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-307903ec-86d7-4755-807f-d261ed634ebe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:05.465130 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-307903ec-86d7-4755-807f-d261ed634ebe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1222 microversion: 2.1 time: 0.304914 Jun 20 06:04:05.470876 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:05 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:05.485403 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6693c366-8d87-42ba-96f7-bf9814f918bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:05.486430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6693c366-8d87-42ba-96f7-bf9814f918bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:05.639276 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6693c366-8d87-42ba-96f7-bf9814f918bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:05.660455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6693c366-8d87-42ba-96f7-bf9814f918bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1238 microversion: 2.1 time: 0.184619 Jun 20 06:04:05.665318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:05 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1238 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:05.750755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] validate_networks() for [('9ea7947d-6cbe-4d2d-93eb-f19499429cea', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:04:06.378557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:06.379176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:06.391984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:06.392451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:06.398115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:06.398964 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:06.708588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:06.755537 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4584d5ac-8816-4b00-843c-f644d53b3c82 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1271 microversion: 2.1 time: 0.378708 Jun 20 06:04:06.757290 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:06 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1271 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:06.767129 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:06.772602 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:06.788806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:06.789841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:06.790714 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:06.791163 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:06.996798 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:07.006272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-225de116-212d-45af-88f5-e243782ccc6a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1226 microversion: 2.1 time: 0.247573 Jun 20 06:04:07.007135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:06 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1226 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:07.014840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:07.015892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:07.028206 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:07.028899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:07.029791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:07.030238 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:07.238573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:07.267700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f782f56b-d5da-43f6-8a0a-3403c4a4e2d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1242 microversion: 2.1 time: 0.258591 Jun 20 06:04:07.268309 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:07 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:07.317186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:04:07.317707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:04:07.318110 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:04:07.318489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:04:07.318913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:04:07.339862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:07.340322 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:07.341171 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:07.341624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:07.378662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for project ce606b9c1e514773a7201b9e83a8af69. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:04:07.384805 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for user 715da00088754d0e8c6ecfa5a2c9b50c and project ce606b9c1e514773a7201b9e83a8af69. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:04:07.414668 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:04:07.424347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:04:07.522988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-09576de3-016e-498c-924d-c3c4d1a2aa12 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.146753 Jun 20 06:04:07.526207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 15/33] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jun 20 06:04:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 06:04:07.538893 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e7490e93-2040-404f-b5dc-da9388a035ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:07.539494 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e7490e93-2040-404f-b5dc-da9388a035ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:07.680067 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e7490e93-2040-404f-b5dc-da9388a035ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:07.690681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e7490e93-2040-404f-b5dc-da9388a035ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:07.692849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e7490e93-2040-404f-b5dc-da9388a035ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:07.698260 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e7490e93-2040-404f-b5dc-da9388a035ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1281 microversion: 2.20 time: 0.164963 Jun 20 06:04:07.699031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:07 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:07.775810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:07.776994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:07.793457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:07.795790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:07.797795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:07.798071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.025510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:08.026154 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:08.043392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:08.050419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.051646 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:08.053367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.261417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:08.276799 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-121c46f7-8ee1-460e-a275-65f959ec4da5 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1271 microversion: 2.1 time: 0.501399 Jun 20 06:04:08.288407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:07 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1271 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:08.298507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:08.305147 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:08.307638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:08.313503 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3d11e3c5-bab1-4a56-ac41-e2f6b293aec2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1226 microversion: 2.1 time: 0.291866 Jun 20 06:04:08.317818 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 20/36] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:08 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1226 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:08.323009 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:08.323545 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.324419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:08.333332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.414480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:08.424725 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e86d976b-cff4-4fe8-81b3-6115629cfa26 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1242 microversion: 2.1 time: 0.129182 Jun 20 06:04:08.427303 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:08 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:08.729434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:08.730084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:08.742281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:08.744812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.746094 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:08.746902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:08.819630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:08.828202 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:08.829827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:08.830945 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-eada21a1-9236-4d3d-ad66-9372a7a02d61 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1285 microversion: 2.20 time: 0.118514 Jun 20 06:04:08.831556 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 21/38] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:08 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:09.299868 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:09.303085 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:09.312751 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.313242 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.320614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.321097 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.334447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:09.335313 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:09.351518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.352147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.353397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.354326 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.544770 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:09.558241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-34d7f323-d181-4599-bd8d-bbd1d03ca820 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1274 microversion: 2.1 time: 0.228554 Jun 20 06:04:09.559455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 22/39] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:09 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:09.572887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:09.573815 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:09.586921 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.590145 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.591367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.592058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.748156 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:09.760060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a45acf63-bb36-495f-9caf-bb951595c02c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1290 microversion: 2.1 time: 0.197363 Jun 20 06:04:09.761532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 23/40] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:09 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1290 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:09.777665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:09.851120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8e59e45a-47f2-4fae-9b38-1d14a9a056e3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.514744 Jun 20 06:04:09.854580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:09.855389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:09.857661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 18/41] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:09 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:09.865023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.866959 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:09.868047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:09.868683 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:10.266266 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:10.275366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:10.285456 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:10.286673 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0ec62ed6-739c-462f-a40c-af854e5952d5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1333 microversion: 2.20 time: 0.440786 Jun 20 06:04:10.303966 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 24/42] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:09 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1333 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:10.581312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:10.582755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:10.607001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:10.609760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:10.612053 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:10.614571 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:10.778608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:10.779197 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:10.798154 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:10.798790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:10.799430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:10.803392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:11.128652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:11.154162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-be0a5142-8b49-442e-bd3e-ed18d7541b50 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1282 microversion: 2.1 time: 0.580127 Jun 20 06:04:11.156390 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 19/43] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:10 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1282 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:11.179194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:11.180655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:11.201029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:11.202341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:11.206465 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:11.211717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:11.761904 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:11.771373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-504567b8-6326-43e0-b11a-ee913c3def50 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1290 microversion: 2.1 time: 0.996726 Jun 20 06:04:11.777302 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 25/44] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:10 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1290 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:11.794537 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:11.799204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:11.813413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:11.817216 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:11.818254 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:11.822277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.032628 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:12.046705 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:12.048437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:12.053237 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0ef991ba-3080-46c4-89d5-dfc22a4a8f30 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.274257 Jun 20 06:04:12.054086 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 26/45] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:11 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:12.172866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:12.173357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:12.179503 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.192314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.193225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.193662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.528522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:12.538326 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9a94bfbd-0526-4e8a-8a26-a180a5d4d475 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.369370 Jun 20 06:04:12.541611 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 27/46] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:12 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:12.590373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:12.606133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fc86e01b-49e8-43e5-8c45-f7ad28ff517d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 1.444706 Jun 20 06:04:12.607052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 20/47] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:11 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:12.627628 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-47f648ec-39ed-4c1e-a136-27f30b32a9bd req-03a3543b-069d-4d36-a32c-86662f6d5316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32dee7a-6403-4bf3-9381-c238c3c06fa5", "tag": "a0861163-fa79-4bc6-a546-5cea2adf86ba"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:12.645785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-47f648ec-39ed-4c1e-a136-27f30b32a9bd req-03a3543b-069d-4d36-a32c-86662f6d5316 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.646415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-47f648ec-39ed-4c1e-a136-27f30b32a9bd req-03a3543b-069d-4d36-a32c-86662f6d5316 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.679136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-47f648ec-39ed-4c1e-a136-27f30b32a9bd req-03a3543b-069d-4d36-a32c-86662f6d5316 service nova] Creating event network-changed:a0861163-fa79-4bc6-a546-5cea2adf86ba for instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 on hv-cinder-83699 Jun 20 06:04:12.679136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-47f648ec-39ed-4c1e-a136-27f30b32a9bd req-03a3543b-069d-4d36-a32c-86662f6d5316 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117666) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 06:04:12.681015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.681521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.682690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.683497 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.693834 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.compute.rpcapi [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 06:04:12.694741 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117666) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 06:04:12.724852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0ae0ebf3-dc0a-47c6-b37c-e88e3e67d6f5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181765 Jun 20 06:04:12.726775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 28/48] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:12.792045 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:12.792660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:12.799276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.799883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.800925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.802008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.889789 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:12.898642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-739a2446-db68-4f1d-8124-b3f30ffa5ffb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.110893 Jun 20 06:04:12.899519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 21/49] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:12 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:12.929782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-acc43f6d-a8d0-4926-8ace-0fa37c9d95f2 req-f0227af9-5c77-4354-8feb-c43dbc34173f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a14b9a48-4cc1-4fb0-bc59-b22b124b5981", "tag": "edbb2d3c-34d0-4267-b40a-36ff6134ff90"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:12.939607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-acc43f6d-a8d0-4926-8ace-0fa37c9d95f2 req-f0227af9-5c77-4354-8feb-c43dbc34173f service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:12.940062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-acc43f6d-a8d0-4926-8ace-0fa37c9d95f2 req-f0227af9-5c77-4354-8feb-c43dbc34173f service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:12.951528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-acc43f6d-a8d0-4926-8ace-0fa37c9d95f2 req-f0227af9-5c77-4354-8feb-c43dbc34173f service nova] Creating event network-changed:edbb2d3c-34d0-4267-b40a-36ff6134ff90 for instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 on hv-cinder-83699 Jun 20 06:04:12.956453 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-acc43f6d-a8d0-4926-8ace-0fa37c9d95f2 req-f0227af9-5c77-4354-8feb-c43dbc34173f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086411 Jun 20 06:04:12.957107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 29/50] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:04:13.073248 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:13.074365 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:13.080272 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.080728 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.081526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.081973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.143620 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:13.152512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:13.154070 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:13.155192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9e029836-f4a0-4afc-a6c2-22aa4b996f88 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.085891 Jun 20 06:04:13.155754 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 22/51] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:13 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:13.556743 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:13.557471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:13.563681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.564141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.564901 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.565378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.623355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:13.623993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:13.630144 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.630599 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.630965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:13.631401 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.631842 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.639385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d9ce5926-51c5-4291-abdf-e39a17826920 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.087317 Jun 20 06:04:13.640034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 30/52] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:13 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:13.758079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:13.765539 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e83a5e5b-2b97-4c1a-a98d-e18d2c4e2a24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.146079 Jun 20 06:04:13.766315 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 23/53] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:13 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:13.915614 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:13.916230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:13.922565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.923017 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.923802 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:13.924233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:13.986988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:13.994270 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ff4ae3fb-f062-417b-aa4f-eaa28762c6a7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.082593 Jun 20 06:04:13.994840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 31/54] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:13 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:14.172841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:14.173487 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:14.179441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:14.179896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:14.180674 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:14.181150 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:14.246136 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:14.254002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:14.255517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:14.256615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-63b49fbf-3f59-4e7d-b1bc-83f4e62ae5b1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.087620 Jun 20 06:04:14.257199 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 24/55] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:14 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:14.664710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:14.664710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:14.669052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:14.677678 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:14.679054 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:14.679740 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:14.783176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:14.783860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:14.790510 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:14.791034 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:14.791848 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:14.792484 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:14.940010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:14.949688 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9c87e02-24a1-419b-88e6-4daa3f1478bd tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.295236 Jun 20 06:04:14.950835 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 32/56] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:14 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:15.011436 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:15.012099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:15.028040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:15.028614 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:15.029540 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:15.030059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:15.092036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:15.099628 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-51c3b12f-640e-434b-9d13-8e1b4037cdef tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.320305 Jun 20 06:04:15.100284 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 25/57] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:14 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:15.120233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:15.123701 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:15.129835 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-47ff16a3-2c43-4049-99cc-aad0e3666daf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.122632 Jun 20 06:04:15.130812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 33/58] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:15 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:15.276226 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:15.276841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:15.282946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:15.283377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:15.284667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:15.285147 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:15.363733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:15.372505 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:15.374205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:15.375326 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dded3354-9a59-40eb-95ea-b06ae8692605 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.103955 Jun 20 06:04:15.376002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 26/59] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:15 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:15.967939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:15.968901 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:15.976112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:15.978245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:15.979124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:15.979661 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.051190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:16.059916 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aeae3cd7-daae-443c-b9ca-d9b0028ee2ed tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.096399 Jun 20 06:04:16.060507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 34/60] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:15 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:16.124411 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:16.127103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:16.139162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:16.140125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.141423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:16.142146 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.157849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:16.158979 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:16.179544 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:16.179996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.183089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:16.184077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.319760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:16.328388 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8f49991b-e516-48b2-aa4e-018a8c51d6bf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.184200 Jun 20 06:04:16.337968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 35/61] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:16 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:16.389788 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:16.401209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:16.401209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:16.401393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0efe8e64-bd20-497b-8338-73b60d190237 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.282042 Jun 20 06:04:16.401393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 27/62] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:16 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:16.404768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:16.405246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.406201 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:16.414955 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:16.504046 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:16.516199 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:16.517806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:16.518929 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6d280a45-9f5a-45b2-ad27-4ade058ff523 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.128593 Jun 20 06:04:16.522618 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 36/63] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:16 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:17.077962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:17.079030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:17.085787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.086643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.088071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.088768 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.195817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:17.206466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c646ac90-6bf6-48fc-8bf7-6681fc3d7459 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.132481 Jun 20 06:04:17.207083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 28/64] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:17 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:17.348293 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:17.349156 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:17.352946 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:17.358686 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.361860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.362670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.369682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.414494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:17.415115 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:17.418739 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:17.419557 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=26 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:17.420400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:17.425700 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.426155 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.426991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.427427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.497099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:17.506108 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7748b879-f613-4cd9-970a-e8c0ec1d76bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.162913 Jun 20 06:04:17.519794 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 37/65] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:17 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:17.537085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:17.537707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:17.543807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.544135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.544902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:17.545480 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:17.627091 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:17.637953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:17.640873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:17.645937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4f64d315-53bf-4d2e-9ce1-85132ff6b772 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.112512 Jun 20 06:04:17.658276 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 38/66] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:17 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:17.734988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:17.745303 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8d263041-d275-4b88-bc27-21cf6d14658b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.334587 Jun 20 06:04:17.747702 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 29/67] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:17 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:18.235582 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:18.239355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:18.242707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=22 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:18.249699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.250492 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.251679 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.252179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.330776 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:18.340013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3cc269c7-67f8-4d9f-b915-0ab6ff245045 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.114838 Jun 20 06:04:18.340829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 39/68] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:18 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:18.522870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:18.523503 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:18.530978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.531426 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.532380 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.532954 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.551926 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:18.608506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:18.616149 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-59e70d4f-c1f7-4856-b3b7-e82b347898ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.097479 Jun 20 06:04:18.616727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 30/69] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:18 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:18.666865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:18.667483 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:18.674746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.675599 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.676552 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.677428 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.749830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:18.760545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:18.762498 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:18.763830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-89ab8b70-9671-4465-8f9c-678de5c7bdda tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.101722 Jun 20 06:04:18.767517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:18.768569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:18.769119 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 40/70] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:18 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:18.775614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.776250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.777527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:18.778064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:18.969618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:18.977182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8ee641ca-affc-4ee0-8d87-a10ad312545c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.215989 Jun 20 06:04:18.985027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 31/71] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:18 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:19.356868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:19.357667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:19.366520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:19.366839 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:19.370365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:19.370365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:19.475631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:19.484013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-171beca7-a11e-4e26-8f3e-b55b78910cf8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.130983 Jun 20 06:04:19.484918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 41/72] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:19 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:19.633328 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:19.634470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:19.640638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:19.641120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:19.646521 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:19.646986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:19.717083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:19.725758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cf79ab97-16fd-4b4c-b46b-6d2d44604938 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.096524 Jun 20 06:04:19.736604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 32/73] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:19 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:19.785259 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:19.786010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:19.797244 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:19.798580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:19.801600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:19.803223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:19.892035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:19.904242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:19.906902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:19.908485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f0397280-b9eb-465d-bb15-5abea19ed714 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.129677 Jun 20 06:04:19.920202 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 42/74] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:19 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:19.995725 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:19.996516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:20.007840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.008303 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.010330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.011089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.224435 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:20.242834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-39e5f5cb-07b8-4a8b-8c49-60f5057b1013 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.250777 Jun 20 06:04:20.244589 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 33/75] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:19 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:20.503143 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:20.504833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:20.532576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.533415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.534486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.535165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.643776 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:20.658782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-69a787d2-ae80-4ff4-9586-313730922381 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.159792 Jun 20 06:04:20.669636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 43/76] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:20 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:20.743883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:20.746531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:20.759991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.762006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.766448 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.767205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.925060 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:20.928281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:20.929933 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:20.937979 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.938715 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.939719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:20.940511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:20.941618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6ff90657-0f85-4ed6-a1f0-f2edae790fdc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.200937 Jun 20 06:04:20.942200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 34/77] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:20 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:21.100494 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:21.109926 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:21.111352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:21.112937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-95e14fe8-9f60-4269-96a6-48b156f1398c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.189320 Jun 20 06:04:21.113162 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 44/78] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:20 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:21.267565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:21.275741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:21.293116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:21.297527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:21.299352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:21.299979 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:21.566335 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:21.576590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5ed68161-6492-486b-92f7-20f26c332579 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.320756 Jun 20 06:04:21.578037 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 35/79] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:21 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:21.676130 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:21.676741 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:21.683984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:21.684693 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:21.686356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:21.686954 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:21.805340 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:21.815078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9731a531-c9fd-46d9-8ac7-80e27208c64f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.142759 Jun 20 06:04:21.815657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 45/80] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:21 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:21.965050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:21.965708 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:21.973336 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:21.973859 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:21.974634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:21.975266 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:22.053124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:22.064653 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5f185673-455e-42ae-a01d-cf732fa4ec00 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.102358 Jun 20 06:04:22.065603 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 36/81] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:21 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:22.132636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:22.136260 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:22.152690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:22.154861 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:22.156917 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:22.159560 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:22.341101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:22.357838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:22.362682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:22.368887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e628c094-fad8-4f59-b592-d26389cf6107 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.236179 Jun 20 06:04:22.369587 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 46/82] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:22 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:22.595007 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:22.595741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:22.614930 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:22.615394 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:22.616183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:22.616614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:22.832045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:22.833164 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:22.836734 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:22.849436 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:22.849899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:22.850702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:22.851126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:23.092721 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:23.110723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0a2ff8a9-f1f8-48f6-8771-1e41df4dc3dc tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.280744 Jun 20 06:04:23.111521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 47/83] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:22 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:23.127301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:23.128247 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:23.141314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:23.142637 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:23.143638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:23.144283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:23.213071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:23.224199 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-01631afe-3304-4da1-92d0-f2c8a1fb9939 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.632849 Jun 20 06:04:23.236954 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 37/84] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:22 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:23.272342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:23.288519 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aec7a27e-d3cf-4340-a16e-5d35227999b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1296 microversion: 2.1 time: 0.175236 Jun 20 06:04:23.290555 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 48/85] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:23 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:23.389805 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:23.391251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:23.402543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:23.403359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:23.405464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:23.406216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:23.705717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:23.717726 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:23.720217 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:23.721603 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1cec5048-cc22-44f5-90a0-e716c733a1c0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1339 microversion: 2.20 time: 0.338489 Jun 20 06:04:23.722691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 38/86] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:23 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1339 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:24.130732 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:24.131360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:24.139336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:24.139801 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:24.140750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:24.141241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:24.245584 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:24.246132 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:24.260821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:24.264327 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:24.266068 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:24.270038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:24.419057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:24.476245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3a084e82-0d4b-451f-98bc-362b83fd41fe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1280 microversion: 2.1 time: 0.348651 Jun 20 06:04:24.485778 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 49/87] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:24 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:24.512108 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:24.512752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:24.532721 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:24.533252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:24.538571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:24.539124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:24.612455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:25.182164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:25.191339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4eefbe6d-ba44-4686-ade4-a3e547d0ba18 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.953704 Jun 20 06:04:25.213097 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 39/88] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:24 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:25.220904 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:25.223286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:25.236706 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:25.237494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:25.238442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:25.239031 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:25.415640 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:25.427756 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3fe380b7-4fe4-407f-9a84-aeab4b2146e0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.938356 Jun 20 06:04:25.428366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 50/89] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:24 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:25.491333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:25.492173 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:25.505078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:25.506024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:25.507322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:25.508113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:25.646798 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:25.683770 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:25.688558 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:25.690940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-feb6f816-dec4-4c83-80c7-0dc84cba49cd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.475971 Jun 20 06:04:25.692625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 40/90] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:25 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:25.772094 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:25.780721 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ec191be3-1110-4e95-8ded-3bea9cf55d47 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.294014 Jun 20 06:04:25.797477 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 51/91] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:25 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:25.987158 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-70c7d3b2-818e-46bb-9493-0027a890ed66 req-8f46d7f0-49d7-47c8-9caa-9ee9e80829f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa707d4-de8c-4e79-8ea0-053c93eb13cd", "tag": "dc8f630b-b725-48f6-98c9-b243bfba84d3"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:26.015165 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-70c7d3b2-818e-46bb-9493-0027a890ed66 req-8f46d7f0-49d7-47c8-9caa-9ee9e80829f9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.017608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-70c7d3b2-818e-46bb-9493-0027a890ed66 req-8f46d7f0-49d7-47c8-9caa-9ee9e80829f9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.070862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-70c7d3b2-818e-46bb-9493-0027a890ed66 req-8f46d7f0-49d7-47c8-9caa-9ee9e80829f9 service nova] Creating event network-changed:dc8f630b-b725-48f6-98c9-b243bfba84d3 for instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd on hv-cinder-83699 Jun 20 06:04:26.072406 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-70c7d3b2-818e-46bb-9493-0027a890ed66 req-8f46d7f0-49d7-47c8-9caa-9ee9e80829f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117665) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 06:04:26.073595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.074252 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.075259 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.075960 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.086700 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.compute.rpcapi [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 06:04:26.087871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117665) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 06:04:26.110395 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-899f1e7b-bd01-45ee-915a-3b8ee3b717c6 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126734 Jun 20 06:04:26.112666 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 41/92] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:26.211272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:26.212805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:26.219327 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.219864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.221049 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.221774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.406535 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:26.432921 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-62dffc20-4020-45c9-a1c7-007ba1af1f84 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.227237 Jun 20 06:04:26.434378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 52/93] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:26 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:26.453418 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:26.454231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:26.473680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.474482 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.475355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.481480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.714541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:26.715166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:26.724668 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.725158 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:26.725947 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:26.732516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:27.115794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:27.124032 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f19f450e-d646-4906-a73a-e160c72ee675 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.679485 Jun 20 06:04:27.124967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 42/94] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:26 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:27.130236 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:27.130939 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:27.136858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:27.137341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:27.138113 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:27.138551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:27.316336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:27.326473 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:27.328044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:27.329198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-445ed2f2-455d-4f22-98af-ee6fe81e9af4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.621164 Jun 20 06:04:27.330051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 53/95] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:26 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:27.451291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:27.452060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:27.458990 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:27.459444 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:27.460392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:27.460855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:27.530994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:27.548239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e018d428-60ee-4c47-8c75-711293a454d5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.421793 Jun 20 06:04:27.548827 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 43/96] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:27 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:27.750951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:27.759547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2cf27512-10de-40ea-8ca3-e1f84e02d9a0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.312351 Jun 20 06:04:27.760174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 54/97] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:27 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:28.140829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:28.141517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:28.154707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.155161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.155936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.156369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.356323 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:28.357078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:28.366332 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.367465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.369305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.369942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.463711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:28.478695 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0fbcdfbb-8781-4129-ae78-890ca259c58c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.341427 Jun 20 06:04:28.479603 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 44/98] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:28 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:28.567729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:28.568664 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:28.584872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.587855 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.591113 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.591808 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.821998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:28.835737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:28.845238 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9a54c850-62b7-4d95-b75a-cae5d1030144 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.281984 Jun 20 06:04:28.847889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:28.854780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 45/99] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:28 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:28.856788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:28.863099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-69217a91-213b-4da0-a03c-da1c948a70c6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.518686 Jun 20 06:04:28.876428 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 55/100] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:28 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:28.884887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-9cf37312-6306-4a86-ae53-e727b325ce1b req-19d1ba3f-1138-48aa-91e2-6887e2f49f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:28.889105 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:28.890134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:28.904517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9cf37312-6306-4a86-ae53-e727b325ce1b req-19d1ba3f-1138-48aa-91e2-6887e2f49f26 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.906506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.907163 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9cf37312-6306-4a86-ae53-e727b325ce1b req-19d1ba3f-1138-48aa-91e2-6887e2f49f26 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.907767 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.911524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:28.912169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:28.931540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-9cf37312-6306-4a86-ae53-e727b325ce1b req-19d1ba3f-1138-48aa-91e2-6887e2f49f26 service nova] Creating event network-changed:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:04:28.937623 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-9cf37312-6306-4a86-ae53-e727b325ce1b req-19d1ba3f-1138-48aa-91e2-6887e2f49f26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079582 Jun 20 06:04:28.938426 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 46/101] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:29.107330 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:29.118867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7f808913-d4e9-40f6-8965-fee3c3ecde7a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.239757 Jun 20 06:04:29.119703 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 56/102] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:28 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:29.496140 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:29.496840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:29.504385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:29.506215 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:29.507204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:29.507858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:29.649965 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:29.657301 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fc71da06-e39c-423a-bc8d-cff5be68b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.165316 Jun 20 06:04:29.657879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 47/103] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:29 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:29.868618 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:29.869255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:29.875410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:29.875861 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:29.876619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:29.877083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:29.883020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:29.884531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:29.890680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:29.891184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:29.892185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:29.892665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:29.898760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:30.081319 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:30.091006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4c86f28b-ef4d-4941-996b-4bbf71d26aac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.226060 Jun 20 06:04:30.092796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 57/104] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:29 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:30.095294 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:30.103148 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:30.104647 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:30.105785 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5b1e605d-9f52-4f3a-ba3e-1007fdfb636a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.226827 Jun 20 06:04:30.106347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 48/105] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:29 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:30.136526 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.137222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:30.143210 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:30.143661 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:30.144426 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:30.145142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:30.289384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:30.299401 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-08872169-2473-44c4-aca7-d2dad433ec4d tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.167281 Jun 20 06:04:30.300004 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 58/106] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:30 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:30.676323 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.676927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:30.684164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:30.684616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:30.685461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:30.685849 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:30.828599 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:30.839295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a0efec23-04e9-4409-8c73-8982b3ce907b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.169050 Jun 20 06:04:30.840331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 49/107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:30 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:30.956013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-1f8ced24-efb9-47dd-a1fb-fda7b72351cd req-88b45f2d-643b-45d7-97d7-450541ae3f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb733d9-3273-49d6-b7b5-f65a946ca6a3", "tag": "1d80a8fa-234f-4299-9923-0c9ff07fe8f0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:30.967077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1f8ced24-efb9-47dd-a1fb-fda7b72351cd req-88b45f2d-643b-45d7-97d7-450541ae3f4c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:30.967521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1f8ced24-efb9-47dd-a1fb-fda7b72351cd req-88b45f2d-643b-45d7-97d7-450541ae3f4c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:30.982501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-1f8ced24-efb9-47dd-a1fb-fda7b72351cd req-88b45f2d-643b-45d7-97d7-450541ae3f4c service nova] Creating event network-changed:1d80a8fa-234f-4299-9923-0c9ff07fe8f0 for instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 on hv-cinder-83699 Jun 20 06:04:30.990169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-1f8ced24-efb9-47dd-a1fb-fda7b72351cd req-88b45f2d-643b-45d7-97d7-450541ae3f4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038465 Jun 20 06:04:30.990980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 59/108] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:31.109962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.110652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:31.117168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.117704 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.118427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.119148 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.124643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.125495 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:31.132420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.132924 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.134342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.134777 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.335128 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:31.343485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bdc84455-12d1-4756-b848-39b5e215f658 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.238087 Jun 20 06:04:31.344222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 50/109] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:31.347155 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:31.349841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.350452 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:31.356490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:31.356870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.357366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.358131 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.358327 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:31.358567 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.359439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-54c3318c-cff1-4a45-84a3-36f37de5d548 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.239351 Jun 20 06:04:31.370036 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 60/110] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:31.492916 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:31.501686 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-39fa34e6-4e98-4696-ace0-4a423a3fd8c3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.156035 Jun 20 06:04:31.502461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 51/111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:31.855855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.856468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:31.863551 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.864244 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:31.865525 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:31.866071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.040411 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:32.048560 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bc27536a-e938-4040-a1f1-e5393e2b5d97 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.196543 Jun 20 06:04:32.049778 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 61/112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:32.360043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.360657 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:32.366953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:32.367440 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.368209 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:32.368650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.376758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.377399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:32.383418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:32.383885 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.384644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:32.385228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.565042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:32.568660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:32.573544 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2a8189c7-b134-4dc9-b120-f7283a28a228 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.217259 Jun 20 06:04:32.574135 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 52/113] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:32.576353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:32.578047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:32.579356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d318332d-1f33-4a6b-a058-8aea12c4a438 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.206445 Jun 20 06:04:32.579572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.580178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:32.587391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 62/114] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:32.593982 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:32.594440 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.595216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:32.595669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:32.727862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:32.735372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1ef8c2a6-87f8-4589-9a24-c3d6cbcaf3cc tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.160275 Jun 20 06:04:32.735948 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 53/115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:33.065665 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:33.066267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:33.072922 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.073391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.074150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.074580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.200251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:33.207630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-025ad4b6-549f-4fc0-b8de-80206e4c2191 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.145707 Jun 20 06:04:33.208196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 63/116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:33 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:33.589842 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:33.590456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:33.596663 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.597152 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.597257 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:33.597860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:33.597983 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.598343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.604444 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.604887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.605668 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.606095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.788537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:33.792369 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:33.796298 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-60ef6a84-9697-4ea4-84d4-33073b712d8c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.210260 Jun 20 06:04:33.797396 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 54/117] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:33 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:33.800686 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:33.801613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:33.802237 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:33.802362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:33.803340 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ee6186be-12dd-4794-b2b2-6e8bfca707be tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.210008 Jun 20 06:04:33.804175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 64/118] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:33 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:33.808778 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.809257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.810025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:33.810466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:33.938561 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:33.946524 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-21c64d12-21cc-46db-b490-28697741e93b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.147992 Jun 20 06:04:33.947132 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 55/119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:33 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:34.225581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:34.226194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:34.232176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:34.232570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:34.233349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:34.233787 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:34.356137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:34.363412 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a7febbb3-4640-4150-bae6-1d0a489d01ac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.141614 Jun 20 06:04:34.363971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 65/120] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:34 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:34.813659 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:34.814451 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:34.820484 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:34.820933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:34.821496 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:34.821732 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:34.822127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:34.822214 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:34.828286 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:34.828830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:34.829723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:34.830219 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:35.171284 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:35.174719 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:35.179490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:35.181008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:35.182362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ea40a248-0b29-4814-8841-d048ec514e34 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.364719 Jun 20 06:04:35.182923 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 66/121] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:34 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:35.183036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5efd566b-1b88-4d27-8c4e-7c75966a34ec tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.373173 Jun 20 06:04:35.192105 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 56/122] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:34 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:35.192245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:35.192245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:35.194414 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:35.194734 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:35.195533 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:35.196463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:35.329342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:35.332744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:35.337676 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-39f18c8f-b2de-4edd-a1f3-c479d73163d2 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.153816 Jun 20 06:04:35.338224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 67/123] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:35 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:35.380058 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:35.380670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:35.387208 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:35.387658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:35.388411 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:35.388847 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:35.517405 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:35.525411 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-212fec26-d2dc-41e0-bee1-8b6f5b59b1dc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.149204 Jun 20 06:04:35.525967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 57/124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:35 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:36.199219 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:36.199869 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:36.200489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:36.201133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:36.203002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:36.206300 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.206759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.207520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.207957 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.208276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.208725 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.209509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.209941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.411859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:36.418869 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:36.420141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2e6f70fa-3af0-4f5d-acab-107a7e8c629f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.224615 Jun 20 06:04:36.429430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 68/125] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:36 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:36.429430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:36.429430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:36.429825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:36.429825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:36.431325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-302a01d8-837b-4cde-b57c-0c2361b11311 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.234630 Jun 20 06:04:36.432161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 58/126] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:36 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:36.433876 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.434333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.435141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.435574 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.543108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:36.543848 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:36.558524 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.559042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.559880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:36.560579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:36.567524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:36.579566 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-03cf2077-9a9f-434a-adca-d13cc5d861d3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.157548 Jun 20 06:04:36.580263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 69/127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:36 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:36.696738 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:36.704338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-66ed579e-0886-40dd-9dcd-164e7bcefabd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.166041 Jun 20 06:04:36.705033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 59/128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:36 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:37.436916 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.437597 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:37.443603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.444048 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.444795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.445252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.449069 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.449676 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:37.455431 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.455879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.456663 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.457125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.639599 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:37.647559 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2ef99dda-3207-4a15-a0e8-df0aa3baf25f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.214492 Jun 20 06:04:37.648135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 70/129] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:37.654437 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:37.656558 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.657203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:37.662299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:37.663059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.663508 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.663926 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:37.664267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.665301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.665669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b190437a-b258-4868-8fc8-94fb382cc4ac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.220958 Jun 20 06:04:37.666231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 60/130] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:37.721606 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.722225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:37.729375 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.729828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.730608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:37.731039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:37.933544 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:37.942291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1ec4fc2f-05db-4559-8463-9d3efad4933c tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.293007 Jun 20 06:04:37.942889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 71/131] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:38.116850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:38.121271 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-21fd4dcb-0c5e-4ee3-914b-a2d312c6406a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.403428 Jun 20 06:04:38.131286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 61/132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:38.409064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-7c4210d9-6aa8-41a2-b984-fcec61944f75 req-9f193150-05e6-4c49-8652-3b3bb4566b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14b9a48-4cc1-4fb0-bc59-b22b124b5981", "name": "network-vif-plugged", "status": "completed", "tag": "edbb2d3c-34d0-4267-b40a-36ff6134ff90"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:38.417991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7c4210d9-6aa8-41a2-b984-fcec61944f75 req-9f193150-05e6-4c49-8652-3b3bb4566b0c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.418443 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7c4210d9-6aa8-41a2-b984-fcec61944f75 req-9f193150-05e6-4c49-8652-3b3bb4566b0c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:38.430979 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-7c4210d9-6aa8-41a2-b984-fcec61944f75 req-9f193150-05e6-4c49-8652-3b3bb4566b0c service nova] Creating event network-vif-plugged:edbb2d3c-34d0-4267-b40a-36ff6134ff90 for instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 on hv-cinder-83699 Jun 20 06:04:38.436040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-7c4210d9-6aa8-41a2-b984-fcec61944f75 req-9f193150-05e6-4c49-8652-3b3bb4566b0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089208 Jun 20 06:04:38.436629 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 72/133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:38.666296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.666941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:38.672872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.673358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:38.674118 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.674553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:38.683894 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.685202 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:38.692039 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.692664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:38.693722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.694197 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:38.876346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:38.880204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:38.884176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-423c2c4b-750f-4c5a-80ff-6142b44dfe0e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.223343 Jun 20 06:04:38.884792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 62/134] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:38.888204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:38.889717 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:38.890840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1ae55fea-f053-4e1a-8a25-325eb0bafba7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.211148 Jun 20 06:04:38.891392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 73/135] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:38.962183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.962795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:38.968787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.969272 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:38.970035 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:38.970470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:39.097681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:39.105725 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-87e25736-abc6-4860-8a50-f913bed28793 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.147803 Jun 20 06:04:39.106312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 63/136] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:39.138505 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.139141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:39.145345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:39.145794 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:39.146545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:39.146977 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:39.272000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:39.279285 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-42142334-f699-4bc7-908f-e19acff0922e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.144579 Jun 20 06:04:39.279847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 74/137] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:39.902210 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.904395 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:39.909754 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.910304 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:39.911585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:39.912103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:39.912943 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:39.913613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:39.917217 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:39.917673 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:39.918446 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:39.918868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:40.111040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:40.114012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:40.114374 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:40.119606 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a6668395-2a9e-46de-83f3-6071c16bafc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.221851 Jun 20 06:04:40.120337 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 64/138] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:40.123427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:40.124944 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:40.126074 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f25ee6dc-a969-4233-b6ca-6dd7ed01710f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.220559 Jun 20 06:04:40.126175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.126775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 75/139] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:40.126888 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:40.132388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:40.132851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:40.133656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:40.134085 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:40.258157 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:40.265913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-86724498-2f03-459f-bdb9-b686775a4a15 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.144056 Jun 20 06:04:40.266467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 65/140] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:40.295621 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.296163 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:40.302075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:40.302521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:40.303275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:40.303708 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:40.430164 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:40.437455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a9f8bc5d-38b8-4655-bb34-c4de93fc2eac tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.145617 Jun 20 06:04:40.438012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 76/141] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:41.137575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:41.138184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:41.144429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:41.145237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.145237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.145424 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:41.145960 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.146662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.157455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.165141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.166507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.167174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.699771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:41.707474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f94b2e97-d8a4-4c32-aceb-b08a9d6783a4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.574219 Jun 20 06:04:41.709651 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:41.712630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 66/142] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:41 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:41.719872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:41.720387 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:41.720526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:41.722478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:41.723867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2b2be6b7-6492-443e-b504-045f9dd44f0a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.583282 Jun 20 06:04:41.725637 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 77/143] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:41 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:41.730898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:41.731505 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.731801 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:41.731959 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.732902 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.733366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.738159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.738961 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:41.744726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:41.745465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:42.001890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:42.005109 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:42.017420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-00ec6469-e694-40d9-b2a5-7b8f7f87e752 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.290382 Jun 20 06:04:42.019828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a2da850b-26fa-4a6d-a598-627af764d3bb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.305846 Jun 20 06:04:42.020479 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 67/144] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:41 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:42.029818 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 78/145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:41 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:42.725906 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:42.726511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:42.732710 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:42.733189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:42.733970 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:42.734397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:42.745696 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:42.746568 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:42.755914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:42.757017 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:42.758376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:42.759575 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:42.981927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:42.995143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-68e76e8c-e6fd-473d-b94e-946a2edcc3d1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.272386 Jun 20 06:04:42.995929 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 68/146] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:42 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:42.997918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:43.013169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:43.014578 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:43.016547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cef811e8-23c7-473c-8d81-c9d95fcbb307 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.276107 Jun 20 06:04:43.017704 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 79/147] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:42 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:43.038950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:43.039608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:43.042520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:43.043426 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:43.046743 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:43.047053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:43.053350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:43.053350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:43.053689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:43.053689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:43.053689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:43.057166 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:43.297737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:43.305221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:43.306298 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7f5e64fa-3757-4b75-bc5e-ff60b2d3d7a6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.268018 Jun 20 06:04:43.317090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 69/148] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:43 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:43.328227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5a2f53b9-5fd4-47ab-85ef-25b663e825a5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.294069 Jun 20 06:04:43.328827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 80/149] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:43 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:44.014302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:44.014934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:44.021653 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.022101 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.022886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.023313 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.036280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:44.037625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:44.045860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.046863 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.058695 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.058695 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.212006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:44.220006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a4abdacb-962a-44c8-90b8-b8a95dd27158 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.212038 Jun 20 06:04:44.221116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 70/150] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:44 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:44.237517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:44.246864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:44.248619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:44.249760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-21e7a4ca-87c1-4e9a-9129-7c3a0213483b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.218900 Jun 20 06:04:44.250312 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 81/151] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:44 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:44.324369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:44.325003 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:44.331038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.331493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.332248 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.332682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.347610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:44.348324 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:44.354481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.354976 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.355752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:44.356190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:44.551021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:44.559680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-43d76491-dce1-4979-a847-6b4bb196fc24 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.239730 Jun 20 06:04:44.560502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 71/152] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:44 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:44.574352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:44.581737 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2d7eb403-7f61-4497-ba56-04ca9a64f47d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.239744 Jun 20 06:04:44.582513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 82/153] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:44 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:45.237230 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:45.237763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:45.244515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.244963 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.245742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.246173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.267474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:45.268112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:45.274251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.274699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.275460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.275894 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.444179 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:45.448471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:45.454218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-344ae96e-4726-45e3-840f-2069663290af tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.221096 Jun 20 06:04:45.457401 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:45.457564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 72/154] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:45 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:45.459290 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:45.460557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6923cf19-8668-4648-b625-fc6f487d712a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.196906 Jun 20 06:04:45.469532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 83/155] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:45 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:45.577352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:45.578010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:45.584089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.584699 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.585325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.585867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.599379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:45.599978 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:45.607448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.607896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.608863 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.609318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.779543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:45.790025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8ff8433b-df59-411a-acd7-dfbd934b0c00 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.216491 Jun 20 06:04:45.791148 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 73/156] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:45 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:45.796468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-25102b22-e13a-4ef9-9be2-2887911e2e82 req-4f96b62a-8065-4840-b0f3-0c05826dd5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32dee7a-6403-4bf3-9381-c238c3c06fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a0861163-fa79-4bc6-a546-5cea2adf86ba"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:45.804753 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-25102b22-e13a-4ef9-9be2-2887911e2e82 req-4f96b62a-8065-4840-b0f3-0c05826dd5f5 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:45.805843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-25102b22-e13a-4ef9-9be2-2887911e2e82 req-4f96b62a-8065-4840-b0f3-0c05826dd5f5 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:45.817775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-25102b22-e13a-4ef9-9be2-2887911e2e82 req-4f96b62a-8065-4840-b0f3-0c05826dd5f5 service nova] Creating event network-vif-plugged:a0861163-fa79-4bc6-a546-5cea2adf86ba for instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 on hv-cinder-83699 Jun 20 06:04:45.818635 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:45.823083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-25102b22-e13a-4ef9-9be2-2887911e2e82 req-4f96b62a-8065-4840-b0f3-0c05826dd5f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 Jun 20 06:04:45.823861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 74/157] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:45.828122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-081f6e73-8c48-4a56-99ce-60ee661df47c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.233177 Jun 20 06:04:45.828848 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 84/158] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:45 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:46.471485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:46.472188 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:46.479283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.479734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.480508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.480659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:46.481110 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.481434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:46.488135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.488582 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.490080 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.490746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.506723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:46.699584 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:46.702955 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:46.707621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fc611317-ccf3-4c57-8dd0-4b88f228a50e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.240474 Jun 20 06:04:46.708193 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 75/159] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:46 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:46.710956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:46.712639 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:46.713839 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-98eafca5-d18d-4670-a211-3ec47ce60035 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.238752 Jun 20 06:04:46.722243 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 85/160] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:46 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:46.808742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:46.809457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:46.815493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.815941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.816925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.817429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.844425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:46.845057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:46.851092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.851542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.852825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:46.853279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:46.995283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:47.002660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fd85c830-53ca-41bc-a83b-ad793a2788de tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.199285 Jun 20 06:04:47.003240 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 76/161] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:46 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:47.020966 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:47.028988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4006ce8a-aba5-4bdb-97e1-db9347b0dbfd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.188269 Jun 20 06:04:47.029600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 86/162] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:46 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:47.724260 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:47.724818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:47.727436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=95 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:47.731508 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:47.732148 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:47.733050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:47.733510 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:47.734044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=99 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:47.734480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:47.734976 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:47.739691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:47.740141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:47.740901 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:47.741359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:47.930993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:47.934824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:47.938392 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b82da6ac-18c3-43dd-9011-f783c5f97737 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.218101 Jun 20 06:04:47.938956 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 77/163] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:47 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:47.942774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:47.943274 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-cfa0bf07-544e-47d0-a2b3-ce7cc6c0abb2 req-3f015beb-12b6-4e6a-aaf8-799d0fe3b4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa707d4-de8c-4e79-8ea0-053c93eb13cd", "name": "network-vif-plugged", "status": "completed", "tag": "dc8f630b-b725-48f6-98c9-b243bfba84d3"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:47.944301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:47.945426 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-904b0a38-7ec6-47b8-b926-c0b149313914 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.218460 Jun 20 06:04:47.955477 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 87/164] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:47 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:47.955628 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-cfa0bf07-544e-47d0-a2b3-ce7cc6c0abb2 req-3f015beb-12b6-4e6a-aaf8-799d0fe3b4c8 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:47.955628 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-cfa0bf07-544e-47d0-a2b3-ce7cc6c0abb2 req-3f015beb-12b6-4e6a-aaf8-799d0fe3b4c8 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:47.962657 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-cfa0bf07-544e-47d0-a2b3-ce7cc6c0abb2 req-3f015beb-12b6-4e6a-aaf8-799d0fe3b4c8 service nova] Creating event network-vif-plugged:dc8f630b-b725-48f6-98c9-b243bfba84d3 for instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd on hv-cinder-83699 Jun 20 06:04:47.967584 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-cfa0bf07-544e-47d0-a2b3-ce7cc6c0abb2 req-3f015beb-12b6-4e6a-aaf8-799d0fe3b4c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027547 Jun 20 06:04:47.968157 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 78/165] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:48.020072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:48.020679 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:48.026704 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.027155 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.027911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.028342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.046502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:48.046862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:48.053370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.053983 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.054758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.055689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.224034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:48.227986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:48.233228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-97b9540e-090f-4702-bb01-f53ef623bfa6 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.217135 Jun 20 06:04:48.233804 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 88/166] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:48 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:48.235376 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-631a45fc-86a8-4dcf-a122-1a1b1cc2099b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.193485 Jun 20 06:04:48.235938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 79/167] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:48 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:48.955056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:48.955666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:48.961789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.962236 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.963000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.963429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.963857 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:48.964615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:48.971343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.971792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:48.972548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:48.973340 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:49.173424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:49.174982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:49.183352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b7b25183-56a4-41e4-9485-18c4fa11d3c2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.232175 Jun 20 06:04:49.184578 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 89/168] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:48 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:49.186042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:49.187935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:49.189385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0ff8a443-01f4-4ea3-85c8-47dc0c1bd6ec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.230358 Jun 20 06:04:49.189928 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 80/169] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:48 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:49.258507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:49.259126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:49.262553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:49.264111 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:49.271689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:49.271883 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:49.272352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:49.273006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:49.273150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:49.274092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:49.275522 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:49.276029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:49.475981 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:49.483175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:49.483848 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fa2e925f-46f2-41be-acad-ffed617864b4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.237298 Jun 20 06:04:49.485102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 90/170] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:49 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:49.490791 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-063a3d7a-f5a0-4a39-b81e-543cd123a5d3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.243103 Jun 20 06:04:49.491357 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 81/171] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:49 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:50.199710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:50.200318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:50.206362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.206807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.207036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:50.207564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.207994 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.208090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:50.214454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.214973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.215789 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.216222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.391358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:50.395142 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:50.401871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:50.403371 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:50.405300 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6c7f3261-842e-4228-95c0-4caad87969d9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.201379 Jun 20 06:04:50.406018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 82/172] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:50 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:50.416760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:50.424032 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b88587da-2163-4672-9f20-f30c215d0ef3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.228307 Jun 20 06:04:50.424591 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 91/173] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:50 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:50.501449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:50.502051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:50.508081 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.508423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.511012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:50.512019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:50.513098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.513681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.521166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.521769 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.522785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:50.523301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:50.730105 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:50.737886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3e306f4c-6df2-4501-946a-333d7be9ae1d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.231615 Jun 20 06:04:50.738455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 92/174] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:50 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:50.739458 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:50.746820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-17c296e0-0a6e-4dcf-8e47-2169d6cd28b3 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.249249 Jun 20 06:04:50.747374 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 83/175] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:50 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:51.423588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:51.424268 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:51.430212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.430665 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.431426 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.431864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.440416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:51.441053 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:51.447463 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.447918 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.448682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.449158 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.631586 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:51.635626 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:51.639610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:51.641151 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:51.642260 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bb7a6259-6515-4570-a043-5136c06fa194 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.222686 Jun 20 06:04:51.642820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 93/176] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:51 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:51.642969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4f229174-9036-46cc-b850-684a7e2d4dfb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.206221 Jun 20 06:04:51.643788 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 84/177] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:51 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:51.754800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:51.755416 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:51.761782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.762246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.762487 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:51.763013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.763107 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:51.763451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.769033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.769743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.770507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:51.770941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:51.959711 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:51.967206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:51.967581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-87888ca2-17dc-410a-8b20-64b4533abbd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.216646 Jun 20 06:04:51.968154 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 94/178] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:51 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:51.974787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-de936141-be3d-4b47-9a9a-40a8d4f064a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.216089 Jun 20 06:04:51.975348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 85/179] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:51 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:52.659891 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:52.660624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:52.661316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:52.661474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:52.668487 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.669041 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.669232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.669492 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.670255 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.670486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.670683 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.672025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.868154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:52.871415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:52.876361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:52.877892 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:52.878994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-948c5bf7-d745-4739-b0d5-21c70660186f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.222146 Jun 20 06:04:52.879101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2c9701f3-de24-4bef-8bb4-03a62c7923c4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.223283 Jun 20 06:04:52.879557 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 86/180] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:52 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:52.879688 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 95/181] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:52 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:52.984093 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:52.984735 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:52.990592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:52.990847 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.991193 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:52.991314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.992037 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.993022 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.997623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.998063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:52.999023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:52.999600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:53.190136 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:53.193417 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:53.197575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-663c81fa-b130-46e8-b733-04864969dbad tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.217265 Jun 20 06:04:53.198136 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 87/182] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:52 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:53.200993 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-baaa6f3a-33dc-4061-9aaa-ae9abdee994a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.214133 Jun 20 06:04:53.201639 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 96/183] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:52 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:53.895675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:53.896453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:53.897059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:53.897791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:53.903201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:53.903649 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:53.904104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:53.904404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:53.904546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:53.904835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:53.905322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:53.905752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:54.092927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:54.097061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:54.100225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-30d9638f-a876-4cb2-b771-aa4c42742f25 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.208945 Jun 20 06:04:54.100795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 88/184] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:53 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:54.105134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:54.106630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:54.107728 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0c497475-d578-4441-bfe0-42b5b91b865e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.214864 Jun 20 06:04:54.108277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 97/185] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:53 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:54.213937 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:54.214565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:54.217069 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:54.217673 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:54.220472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:54.220914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:54.221712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:54.222138 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:54.223478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:54.223927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:54.224687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:54.225143 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:54.598187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:54.601013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:54.606667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-85371c03-2d50-42f3-b540-a6a06662a115 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.396371 Jun 20 06:04:54.607506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 89/186] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:54 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:54.614408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f32a7525-b03a-4595-9900-bccfc16a73fb tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.395734 Jun 20 06:04:54.614408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 98/187] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:54 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:55.116264 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:55.116866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:55.123471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.123923 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.124673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.125137 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.125461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:55.126070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:55.131976 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.132421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.133198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.133632 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.317131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:55.321421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:55.325844 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:55.328739 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9d4e959d-bdc8-4004-8bc2-4a0b9eb0c660 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.216253 Jun 20 06:04:55.329334 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 90/188] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:55 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:55.331590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:55.332724 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cb3e606b-82d5-4c94-bb60-3b3a624bde4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.211011 Jun 20 06:04:55.333310 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 99/189] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:55 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:55.624212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:55.624763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:55.626145 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:55.626756 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:55.632397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.633410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.633783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.634181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.634286 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.634611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.634976 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:55.635406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:55.831397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:55.835628 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:55.843691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1ceab964-f773-4781-9bce-061eef0e75a0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.223488 Jun 20 06:04:55.854246 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 91/190] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:55 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:55.855626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fe380d5c-b8db-4f8d-af79-e29ecf9d940e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.233052 Jun 20 06:04:55.856241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 100/191] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:55 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:56.345827 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:56.346439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:56.350597 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:56.351204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:56.352750 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.353233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.353996 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.354427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.357511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.358067 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.358840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.359279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.551919 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:56.565795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:56.569397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:56.575371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:56.576873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:56.578008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-78ddc76d-2dd9-4548-bcdc-3ef29a1d4f2f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.231263 Jun 20 06:04:56.578553 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 101/192] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:56 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:56.582110 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-995400be-9d23-4b06-a66e-ca009f0bbf9f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.239971 Jun 20 06:04:56.583256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 92/193] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:56 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:56.587512 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-7db7045c-bcf9-4613-a293-393c5f15a611 req-7e2d5015-356e-4c10-b1cb-7eee582ae9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb733d9-3273-49d6-b7b5-f65a946ca6a3", "name": "network-vif-plugged", "status": "completed", "tag": "1d80a8fa-234f-4299-9923-0c9ff07fe8f0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:56.596803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7db7045c-bcf9-4613-a293-393c5f15a611 req-7e2d5015-356e-4c10-b1cb-7eee582ae9e3 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.597308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7db7045c-bcf9-4613-a293-393c5f15a611 req-7e2d5015-356e-4c10-b1cb-7eee582ae9e3 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.622829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-7db7045c-bcf9-4613-a293-393c5f15a611 req-7e2d5015-356e-4c10-b1cb-7eee582ae9e3 service nova] Creating event network-vif-plugged:1d80a8fa-234f-4299-9923-0c9ff07fe8f0 for instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 on hv-cinder-83699 Jun 20 06:04:56.627896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-7db7045c-bcf9-4613-a293-393c5f15a611 req-7e2d5015-356e-4c10-b1cb-7eee582ae9e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047647 Jun 20 06:04:56.628494 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 102/194] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:56.863017 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:56.863776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:56.873784 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:56.874247 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.876059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:56.884721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.884721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.884721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.885209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.885209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:56.885209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:56.885209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:57.126854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:57.134654 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8c5b0115-dfb2-487c-a03b-81e44f416b21 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1313 microversion: 2.1 time: 0.266581 Jun 20 06:04:57.145720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 103/195] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:56 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:57.146291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:57.155911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8577fb48-8947-45ac-933c-2ad8e6561430 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.297874 Jun 20 06:04:57.157065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 93/196] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:56 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:57.595654 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:57.596257 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:57.599241 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:57.599730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:57.602672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:57.602790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:57.603521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:57.603969 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:57.605745 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:57.606331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:57.607084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:57.607564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:57.798799 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:57.801895 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:57.806830 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b565b2f1-945c-4efb-a753-544f76541181 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.211572 Jun 20 06:04:57.807399 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 94/197] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:57 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:57.810488 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:57.812190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:57.813413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f489f12c-ee7c-43c5-ad5e-718ca0c68cbe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.221866 Jun 20 06:04:57.814033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 104/198] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:57 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:58.152802 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:58.153380 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:58.159344 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.159795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.160555 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.161008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.173760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:58.174362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:58.180795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.181274 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.182059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.182487 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.354828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:58.361616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:58.362162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-41cf62e0-8b6c-44fc-a309-933a87fd49a1 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1500 microversion: 2.1 time: 0.213364 Jun 20 06:04:58.362731 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 95/199] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:58 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1500 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:58.368927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f5fd267c-2139-42a2-83ee-cb9f9c0fb496 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.198908 Jun 20 06:04:58.369511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 105/200] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:58 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:58.823767 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:58.824370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:58.830350 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.830795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.831405 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:58.831802 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.831964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.832057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:58.838554 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.838998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:58.839740 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:58.840169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:59.025498 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:59.029534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:59.033310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0dd31e17-aac8-4915-9259-675649bde4f6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.213328 Jun 20 06:04:59.034051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 96/201] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:58 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:59.037878 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:59.039388 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:59.040494 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-61b8cf9a-98ba-440e-a215-01fc649a6282 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.212905 Jun 20 06:04:59.041331 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 106/202] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:04:58 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:59.385820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:59.386420 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:04:59.392288 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:59.392728 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:59.393512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:04:59.393941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:04:59.520476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:04:59.528169 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d6a5ff07-9414-4ae9-a58a-b3fd8a45f8e2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.146915 Jun 20 06:04:59.528723 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 97/203] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:04:59 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:00.049577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:00.050191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:00.056337 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.056795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.057607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.058044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.058759 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:00.060193 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:00.067217 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.067957 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.069054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.069589 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.249034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:00.256504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f59575e2-62ef-448a-94d1-107df7de76f4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.210573 Jun 20 06:05:00.257097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 107/204] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:00 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:00.261476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:00.269256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:00.271018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:00.272125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-21f80865-35d8-4e72-be52-ffc791054cd4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.217872 Jun 20 06:05:00.272956 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 98/205] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:00 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:00.416571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-8f543356-894b-4fe6-8c43-97eb34b84646 req-713698a9-05ae-4b19-adc1-a29a9cce7474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "name": "network-vif-plugged", "status": "completed", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:00.426127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-8f543356-894b-4fe6-8c43-97eb34b84646 req-713698a9-05ae-4b19-adc1-a29a9cce7474 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.426587 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-8f543356-894b-4fe6-8c43-97eb34b84646 req-713698a9-05ae-4b19-adc1-a29a9cce7474 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.438894 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-8f543356-894b-4fe6-8c43-97eb34b84646 req-713698a9-05ae-4b19-adc1-a29a9cce7474 service nova] Creating event network-vif-plugged:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:05:00.443772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-8f543356-894b-4fe6-8c43-97eb34b84646 req-713698a9-05ae-4b19-adc1-a29a9cce7474 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Jun 20 06:05:00.444354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 108/206] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:00.545353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:00.545973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:00.551994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.552449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.553238 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:00.553676 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:00.571649 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:00.682461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:00.690415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dc164efb-f31a-411a-92a1-1d1e0c96f280 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.148745 Jun 20 06:05:00.690978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 99/207] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:00 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:01.274282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:01.274981 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:01.281572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:01.281992 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:01.282748 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:01.283181 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:01.290295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:01.291061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:01.297080 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:01.297531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:01.298280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:01.298864 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:01.497221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:01.500061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:01.505180 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:01.506673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:01.507376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1e1ff024-79ea-4df9-ad75-55aef574a2d4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.237993 Jun 20 06:05:01.508354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f1f976ad-7620-472e-a126-c6bf8eb759e8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.221378 Jun 20 06:05:01.509020 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 109/208] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:01 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:01.509245 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 100/209] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:01 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:01.707471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:01.707984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:01.714401 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:01.714853 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:01.715604 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:01.716033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:01.845237 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:01.852673 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d7f7ac56-6540-4881-ba97-a91deae939cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.149021 Jun 20 06:05:01.853266 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:01 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:02.525180 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:02.525784 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:02.526003 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:02.526633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:02.531732 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:02.532176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:02.532478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:02.532928 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:02.533046 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:02.533380 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:02.533710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:02.534142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:02.719676 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:02.726877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:02.727831 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b3d1af43-9deb-49ce-a460-201374dbeb3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.206314 Jun 20 06:05:02.728500 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 101/211] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:02 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:02.735890 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:02.737398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:02.738499 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d6389922-c3ab-4184-9acb-c79a9cba9a00 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.216455 Jun 20 06:05:02.739054 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 111/212] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:02 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:02.869481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:02.870113 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:02.876023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:02.876474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:02.877256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:02.877696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:03.005415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:03.013441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-74277f52-dc3e-4e28-8516-0e055a0ef3c3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.147775 Jun 20 06:05:03.014013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 102/213] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:02 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:03.746826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:03.747468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:03.754084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:03.754614 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:03.755430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:03.755916 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:03.758257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:03.758863 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:03.764671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:03.765196 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:03.766050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:03.766554 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:03.955442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:03.963274 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:03.964777 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:03.965959 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d9e2c5b4-b268-4ed2-a2eb-7eb4fea479cb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.212660 Jun 20 06:05:03.966509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 103/214] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:03 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:03.966875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:03.974690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5acd1979-f639-42ec-a8ee-d3718f60b72c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.232836 Jun 20 06:05:03.975225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c011bef-a65f-4321-81b5-c87e1c2557d9"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:03.975373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 112/215] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:03 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:03.976790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:03.983202 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:03.983835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:03.984874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:03.985447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:04.031013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:04.035577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:04.042867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:04.043713 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:04.044713 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:04.045172 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:04.194390 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:04.201399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9156b233-60b7-4fcc-bf46-ce779e9e4147 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1364 microversion: 2.1 time: 0.174251 Jun 20 06:05:04.201961 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 113/216] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:04 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:04.987510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:04.987510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:04.991433 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:04.992513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:04.993293 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:04.993727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.028773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8bab662c-8e36-4599-b2c0-5403d3cc688b tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "POST /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.057553 Jun 20 06:05:05.034150 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 104/217] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:05:03 2022] POST /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5/os-volume_attachments => generated 194 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:05.035258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:05.035968 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:05.044937 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:05.045545 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.046418 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:05.046962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.188127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:05.196762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:05.198414 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:05.199583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-42cb7430-53c7-49a2-a918-e3f1eb97e3a1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.219574 Jun 20 06:05:05.200220 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 114/218] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:04 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:05.218138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:05.218836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:05.219562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:05.224729 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:05.225229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.225997 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:05.226475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.227017 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-de659413-ba7a-4af2-919c-a872ae0649e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1322 microversion: 2.1 time: 0.195862 Jun 20 06:05:05.227642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 105/219] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:05 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:05.369187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:05.376964 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-50d48e85-bf05-467e-a18b-b4f9223d54a8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1550 microversion: 2.1 time: 0.162653 Jun 20 06:05:05.377556 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 115/220] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:05 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:05:05.401129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:05.401648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:05.408254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:05.408842 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.410088 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:05.410749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:05.487493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-75662c39-f13a-420c-92f5-db42c6589660 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096550 Jun 20 06:05:05.488095 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 106/221] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:05:05 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:06.217799 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:06.218574 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:06.225373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.226144 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.227123 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.228000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.246266 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:06.247120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:06.256696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.258745 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.263046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.264337 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.748110 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:06.756965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:06.766423 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:06.769107 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8be4b762-8bd6-42d7-b32d-9b78391f2d6e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1516 microversion: 2.1 time: 0.528957 Jun 20 06:05:06.769966 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 107/222] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:06 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1516 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:06.771516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:06.772644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b69cfacb-796a-486c-bb2f-5e328773891e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.558990 Jun 20 06:05:06.773369 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 116/223] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:06 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:06.792885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:06.794553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:06.801591 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.802347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.803196 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.803704 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.835544 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lazy-loading 'flavor' on Instance uuid bbb733d9-3273-49d6-b7b5-f65a946ca6a3 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:05:06.956989 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-819cd6b4-d8b5-447a-932e-eeed41eafee8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3/action" status: 200 len: 32 microversion: 2.1 time: 0.168269 Jun 20 06:05:06.957967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 108/224] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:05:06 2022] POST /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:05:06.967165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:06.967905 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:06.974014 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.974458 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:06.975327 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:06.975832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:07.243011 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:07.253791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f74f080d-6ae4-4005-9b93-aac186b95ef5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.290409 Jun 20 06:05:07.254377 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 117/225] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:06 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:07.412179 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-228574b9-9898-47bf-9837-17bea4b28cd3 req-24b15d1b-b22c-4522-a1f4-e6468115e8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa707d4-de8c-4e79-8ea0-053c93eb13cd", "tag": "dc8f630b-b725-48f6-98c9-b243bfba84d3"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:07.421662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-228574b9-9898-47bf-9837-17bea4b28cd3 req-24b15d1b-b22c-4522-a1f4-e6468115e8fc service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:07.422103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-228574b9-9898-47bf-9837-17bea4b28cd3 req-24b15d1b-b22c-4522-a1f4-e6468115e8fc service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:07.435687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-228574b9-9898-47bf-9837-17bea4b28cd3 req-24b15d1b-b22c-4522-a1f4-e6468115e8fc service nova] Creating event network-changed:dc8f630b-b725-48f6-98c9-b243bfba84d3 for instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd on hv-cinder-83699 Jun 20 06:05:07.440673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-228574b9-9898-47bf-9837-17bea4b28cd3 req-24b15d1b-b22c-4522-a1f4-e6468115e8fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032845 Jun 20 06:05:07.441195 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 109/226] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:07.790465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:07.791089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:07.797478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:07.797928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:07.798879 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:07.799317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:07.972816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:07.982406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:07.983911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:07.985054 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-262b9e11-e27c-4dc6-bfd8-f19db89dbe86 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.198597 Jun 20 06:05:07.995001 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 118/227] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:07 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:08.272900 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:08.273790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:08.280170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:08.280627 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:08.281476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:08.281960 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:08.435568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:08.453895 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d3ff1746-f966-4a77-9237-282acf1f8ec9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.186568 Jun 20 06:05:08.455136 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 110/228] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:08 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:09.004392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:09.004392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:09.010886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:09.011335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:09.012095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:09.012584 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:09.142126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:09.146002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:09.152175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:09.153815 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:09.154938 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e62fcf07-a315-4525-add5-e9f4057dea75 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.156295 Jun 20 06:05:09.155490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 119/229] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:08 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:09.471075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:09.471685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:09.478233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:09.478681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:09.479440 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:09.479870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:09.618494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:09.626519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1e0a9c42-01bd-4b3c-ba2a-fcc432c45311 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.159244 Jun 20 06:05:09.627082 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 111/230] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:09 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:10.175301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:10.177781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:10.187655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:10.188487 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:10.189603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:10.190305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:10.383126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:10.395433 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:10.397122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:10.398670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-479e3335-2ae4-423c-bf30-beda8c607528 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1407 microversion: 2.20 time: 0.228490 Jun 20 06:05:10.410805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 120/231] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:10 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:10.643407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:10.644014 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:10.650634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:10.651102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:10.651834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:10.652262 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:10.835918 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:10.847780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3e0da7ab-c4e8-497d-a23f-30232a352705 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.207565 Jun 20 06:05:10.848937 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 112/232] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:10 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:11.416423 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:11.419994 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:11.423481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:11.423932 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:11.424700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:11.425223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:11.567136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:11.575166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:11.576652 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:11.577821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7ef736ed-c37e-4385-8ea7-5252af278d15 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1598 microversion: 2.20 time: 0.165971 Jun 20 06:05:11.578366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 121/233] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:05:11 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:11.596682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:11.597450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:11.605165 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:11.605618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:11.606579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:11.607021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:11.688261 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c0e73255-a341-4401-8135-4279711d024b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095459 Jun 20 06:05:11.688886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 113/234] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jun 20 06:05:11 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:05:11.866521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:11.868083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:11.875145 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:11.875591 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:11.876541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:11.876969 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:12.552519 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:12.576179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8c4a13bc-c09f-4576-a359-76520a91a605 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.713274 Jun 20 06:05:12.577540 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 122/235] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:11 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:13.596824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:13.598086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:13.607161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:13.607654 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:13.608595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:13.609237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:13.625861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:13.734795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-b104ca0c-d112-48d3-83d6-40d4c01d7678 req-9fcd7e7d-f270-437e-89df-ea6cdf651764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:13.755412 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b104ca0c-d112-48d3-83d6-40d4c01d7678 req-9fcd7e7d-f270-437e-89df-ea6cdf651764 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:13.755867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b104ca0c-d112-48d3-83d6-40d4c01d7678 req-9fcd7e7d-f270-437e-89df-ea6cdf651764 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:13.782658 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-b104ca0c-d112-48d3-83d6-40d4c01d7678 req-9fcd7e7d-f270-437e-89df-ea6cdf651764 service nova] Creating event network-changed:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:05:13.797663 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-b104ca0c-d112-48d3-83d6-40d4c01d7678 req-9fcd7e7d-f270-437e-89df-ea6cdf651764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076879 Jun 20 06:05:13.800306 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 123/236] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:13.841941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:13.850435 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-58dc2bd4-69ab-4e2b-9c71-8e6d8d25dfa7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.258581 Jun 20 06:05:13.860612 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 114/237] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:13 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:14.870136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:14.870967 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:14.884586 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:14.885096 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:14.886120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:14.887518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:15.077502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:15.091395 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6a65bb73-af43-4c3c-aa3b-694a6278030c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.226985 Jun 20 06:05:15.100668 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 124/238] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:14 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:16.113613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:16.115480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:16.124283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:16.124860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:16.125891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:16.126341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:16.277661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:16.285571 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ffaa56e9-52b3-4ae6-a63a-9eb1f76eed70 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.175969 Jun 20 06:05:16.286140 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 115/239] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:16 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:17.303314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:17.304868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:17.311733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:17.312442 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:17.313267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:17.313939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:17.467791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:17.475538 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-18776fb9-f471-43aa-880e-6c037ba9c638 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.176301 Jun 20 06:05:17.476161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 125/240] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:17 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:18.492340 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:18.493429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:18.497572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=78 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:18.501559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:18.502015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:18.502809 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:18.503243 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:18.686964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:18.696839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1de6e3c8-5071-4555-9061-e59b767ef32f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.208110 Jun 20 06:05:18.701052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 116/241] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:18 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:19.719720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:19.720555 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:19.724204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=78 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:19.729038 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:19.729565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:19.730592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:19.731105 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:19.887172 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:19.898252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5da1f93e-a986-4003-b5de-7f756c02d915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.181939 Jun 20 06:05:19.900221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 126/242] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:19 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:20.246273 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:20.247465 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:20.253737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:20.254192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:20.254929 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:20.255358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:20.281460 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:05:20.369001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a9b43bdd-e7ab-44e7-a05c-a55ca3c3f18a tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 204 len: 0 microversion: 2.1 time: 0.126260 Jun 20 06:05:20.369687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 117/243] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:05:20 2022] DELETE /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:05:20.378058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:20.378892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:20.385669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:20.386283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:20.387312 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:20.387991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:20.539142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:20.549250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-295d40d5-dde1-45b1-af92-41eaec004935 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1552 microversion: 2.1 time: 0.175356 Jun 20 06:05:20.550043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 127/244] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:20 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1552 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:20.919999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:20.920921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:20.933602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:20.933994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:20.935084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:20.935675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:21.105655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:21.115140 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-aa156a8b-691d-46a8-bcdf-7852b8914480 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.200189 Jun 20 06:05:21.117320 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 118/245] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:20 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:21.567912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:21.568413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:21.576049 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:21.580852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:21.581746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:21.582256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:21.764049 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:21.772988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-45c804dc-ff14-41d1-bc91-69d4f3312700 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1552 microversion: 2.1 time: 0.209358 Jun 20 06:05:21.776275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 128/246] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:21 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:22.133086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:22.133705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:22.145057 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:22.145823 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:22.146637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:22.147081 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:22.372724 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:22.383366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c5a255a4-cff9-4aa5-baac-a07cf2c72231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.254011 Jun 20 06:05:22.384517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 119/247] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:22 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:22.791903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:22.792517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:22.798887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:22.799564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:22.800444 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:22.801002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:23.129536 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:23.144638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8e1c50b3-f8d0-431b-9598-b63344d0f6d4 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1552 microversion: 2.1 time: 0.355659 Jun 20 06:05:23.150507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 129/248] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:22 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1552 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:23.400135 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:23.400844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:23.409655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:23.410484 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:23.411716 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:23.412432 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:23.748339 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-46e60f1d-8ecb-4a7c-87fe-361a00e92d11 req-f76a47e9-1f3b-49e5-98f4-42c1d47889a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32dee7a-6403-4bf3-9381-c238c3c06fa5", "name": "network-vif-deleted", "tag": "a0861163-fa79-4bc6-a546-5cea2adf86ba"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:23.758921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:23.761499 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-46e60f1d-8ecb-4a7c-87fe-361a00e92d11 req-f76a47e9-1f3b-49e5-98f4-42c1d47889a9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:23.762345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-46e60f1d-8ecb-4a7c-87fe-361a00e92d11 req-f76a47e9-1f3b-49e5-98f4-42c1d47889a9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:23.780120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-46e60f1d-8ecb-4a7c-87fe-361a00e92d11 req-f76a47e9-1f3b-49e5-98f4-42c1d47889a9 service nova] Creating event network-vif-deleted:a0861163-fa79-4bc6-a546-5cea2adf86ba for instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 on hv-cinder-83699 Jun 20 06:05:23.791336 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ccced04c-7e86-4293-9250-6ee107263b1d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.390640 Jun 20 06:05:23.794671 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-46e60f1d-8ecb-4a7c-87fe-361a00e92d11 req-f76a47e9-1f3b-49e5-98f4-42c1d47889a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051287 Jun 20 06:05:23.797171 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 120/249] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:23 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:23.798008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 130/250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:24.164764 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:24.166195 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:24.176730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:24.177223 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:24.177995 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:24.178773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:24.244144 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2836ce30f99f4a5ab66bea1553a2b038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f3449a9b4040b9ac30f285b7b13e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:24.254734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c8cb05dc-b522-4387-8ec4-34fe7f7c1fc0 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 200 len: 1344 microversion: 2.1 time: 0.095518 Jun 20 06:05:24.262077 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 121/251] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:24 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 1344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:05:24.812485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:24.813212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:24.821570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:24.822260 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:24.823141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:24.823622 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:24.984084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:24.992745 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fc747078-e84d-4a91-a7be-c45b3efd97e9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.186244 Jun 20 06:05:24.993372 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 131/252] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:24 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:25.278991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.279782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:25.286516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:25.287026 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:25.288004 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:25.288441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:25.302231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] HTTP exception thrown: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Request method failure captured: Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 HTTP/1.1 Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3MC4Y4oTLegaXHNsLoeMTbuxdDmAOZLVqehKPKON8mdlzWCxnEH5pnqxUGtLlAsa2NYMpRT47_Sr02mWyBsqCYYWE1Ds6UAreJKRu-sD_GSkIWAmgIYuOh5MdXLl3I-hGKwErWURLKDP-V1hY28-l-sYnukAEmTgE6eNwIoGynwKo Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:05:25.307211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7f3449a9b4040b9ac30f285b7b13e38", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 2836ce30f99f4a5ab66bea1553a2b038 Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.308660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'd32dee7a-6403-4bf3-9381-c238c3c06fa5'} Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:25.312643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.314235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.315197 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Returning 404 to user: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:25.315197 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f3aea86a-82f5-4ba4-80b8-5ac0484e001e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 404 len: 111 microversion: 2.1 time: 0.033453 Jun 20 06:05:25.315197 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 122/253] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:25 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:05:25.438210 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.439596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:25.451642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:25.452113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:25.452861 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:25.453385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:25.531376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] HTTP exception thrown: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Request method failure captured: Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5/os-volume_attachments HTTP/1.1 Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3MC4Y4oTLegaXHNsLoeMTbuxdDmAOZLVqehKPKON8mdlzWCxnEH5pnqxUGtLlAsa2NYMpRT47_Sr02mWyBsqCYYWE1Ds6UAreJKRu-sD_GSkIWAmgIYuOh5MdXLl3I-hGKwErWURLKDP-V1hY28-l-sYnukAEmTgE6eNwIoGynwKo Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:05:25.559723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7f3449a9b4040b9ac30f285b7b13e38", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 2836ce30f99f4a5ab66bea1553a2b038 Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.561166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'server_id': 'd32dee7a-6403-4bf3-9381-c238c3c06fa5'} Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:25.561927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:25.563166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:25.565354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Returning 404 to user: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:25.565354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5f1ea4b3-d70a-46b2-aafc-0928ef22a24e tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.129996 Jun 20 06:05:25.565354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 132/254] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:05:25 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5/os-volume_attachments => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:05:26.011128 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:26.011819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:26.018665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:26.019123 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:26.020389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:26.020857 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:26.200534 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:26.208853 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-afa01d47-b78a-4c7a-b09f-0fc23fd0359f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.202782 Jun 20 06:05:26.210525 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 123/255] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:26 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:26.847457 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:26.847995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:26.860343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:26.861026 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:26.862022 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:26.862667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:26.883633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] HTTP exception thrown: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Request method failure captured: Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 HTTP/1.1 Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3MC4Y4oTLegaXHNsLoeMTbuxdDmAOZLVqehKPKON8mdlzWCxnEH5pnqxUGtLlAsa2NYMpRT47_Sr02mWyBsqCYYWE1Ds6UAreJKRu-sD_GSkIWAmgIYuOh5MdXLl3I-hGKwErWURLKDP-V1hY28-l-sYnukAEmTgE6eNwIoGynwKo Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:05:26.886037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7f3449a9b4040b9ac30f285b7b13e38", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 2836ce30f99f4a5ab66bea1553a2b038 Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.887240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'd32dee7a-6403-4bf3-9381-c238c3c06fa5'} Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:26.887942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.888999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.891757 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Returning 404 to user: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:26.892803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2bbd7570-9c77-4a37-b1bb-91986c0bac85 tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 404 len: 111 microversion: 2.1 time: 0.050955 Jun 20 06:05:26.893790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 133/256] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:05:26 2022] DELETE /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:05:26.903295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:26.903914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] [instance: d32dee7a-6403-4bf3-9381-c238c3c06fa5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:26.913658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:26.914151 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:26.914882 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:26.915541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:26.942790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] HTTP exception thrown: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Request method failure captured: Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 HTTP/1.1 Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3MC4Y4oTLegaXHNsLoeMTbuxdDmAOZLVqehKPKON8mdlzWCxnEH5pnqxUGtLlAsa2NYMpRT47_Sr02mWyBsqCYYWE1Ds6UAreJKRu-sD_GSkIWAmgIYuOh5MdXLl3I-hGKwErWURLKDP-V1hY28-l-sYnukAEmTgE6eNwIoGynwKo Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:05:26.957332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7f3449a9b4040b9ac30f285b7b13e38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7f3449a9b4040b9ac30f285b7b13e38", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: f7f3449a9b4040b9ac30f285b7b13e38 Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-DeleteServersTestJSON-1366141373 Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 2836ce30f99f4a5ab66bea1553a2b038 Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-DeleteServersTestJSON-1366141373-project Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.958466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'd32dee7a-6403-4bf3-9381-c238c3c06fa5'} Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:26.959089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. Jun 20 06:05:26.961383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:26.963585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] Returning 404 to user: Instance d32dee7a-6403-4bf3-9381-c238c3c06fa5 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:26.963585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e98f5d72-68ac-41f1-a04a-bcf98817f9bf tempest-DeleteServersTestJSON-1366141373 tempest-DeleteServersTestJSON-1366141373-project] 10.222.0.20 "GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5" status: 404 len: 111 microversion: 2.1 time: 0.060309 Jun 20 06:05:26.963585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 124/257] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:26 2022] GET /compute/v2.1/servers/d32dee7a-6403-4bf3-9381-c238c3c06fa5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:05:27.227920 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:27.229512 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:27.237318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:27.238063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:27.239088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:27.239675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:27.588150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:27.596867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-88ce4fe8-cc99-4d7b-ae64-549ac0b19dc0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.374089 Jun 20 06:05:27.602562 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 134/258] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:27 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:28.618197 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:28.618947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:28.632748 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:28.634660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:28.636448 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:28.637087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:28.957295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:28.965290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cda5f095-8258-4988-bb18-bc7e28331abf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.355077 Jun 20 06:05:28.966269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 125/259] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:28 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:05:29.982700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:29.983311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:29.990715 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:29.991663 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:29.992419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:29.992852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:30.265831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:30.274810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a921bc10-98f0-45b3-9f52-4c0b792d3083 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.295808 Jun 20 06:05:30.275523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 135/260] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:29 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:31.294596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:31.295240 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:31.346678 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:31.347991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:31.348792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:31.349260 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:31.491656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:31.500129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-730467b7-c976-4b7a-b55a-e782e7cdb071 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.212155 Jun 20 06:05:31.500724 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 126/261] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:31 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:32.518995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.519855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:32.532120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:32.532794 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:32.535424 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:32.535832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:32.715895 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:32.727030 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1b3fab13-81a7-4665-9504-8fe3fe64746d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.210138 Jun 20 06:05:32.727030 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 136/262] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:33.051686 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ba914793-3355-4ff3-acdd-e852515a4736 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Action: 'create', calling method: .version_select at 0x7f9d442f5e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-547875955", "metadata": {"Type": "work"}}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ba914793-3355-4ff3-acdd-e852515a4736 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Request method failure captured: Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 121 Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA4sUgP4yxeIg_zM7oKh4ROSFmgMDTPBPZfNZZyv37KOx6aquVKtQxC2S3TTuOmkCzi7FG56MzACLiKSxHVKnCLYXjyP1ZObqfho37TE9Ht6WV5kgZxUudI5ZMn34-WDCfRmts44fV5LXfWsaToccv2P2CuSbgx_Ssu3ge8ihXd_38c Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:05:33.082206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef0ea55fd62446b8acc4051f02c4f053", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: adac9aca30e240ef80159f37adee7371 Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-547875955", "metadata": {"Type": "work"}}} Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: Jun 20 06:05:33.083680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-547875955', 'metadata': {'Type': 'work'}}}} Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:33.086065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:05:33.087449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:05:33.088436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:05:33.088436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.088436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ba914793-3355-4ff3-acdd-e852515a4736 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:33.088436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ba914793-3355-4ff3-acdd-e852515a4736 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154335 Jun 20 06:05:33.088436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 127/263] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 20 06:05:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:05:33.092258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75672682-66c5-4185-99a8-0c62d3a6ece3 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Action: 'create', calling method: .version_select at 0x7f9d4440c430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1722636479", "metadata": {"Type": "work"}}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75672682-66c5-4185-99a8-0c62d3a6ece3 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Request method failure captured: Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 120 Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA4sUgP4yxeIg_zM7oKh4ROSFmgMDTPBPZfNZZyv37KOx6aquVKtQxC2S3TTuOmkCzi7FG56MzACLiKSxHVKnCLYXjyP1ZObqfho37TE9Ht6WV5kgZxUudI5ZMn34-WDCfRmts44fV5LXfWsaToccv2P2CuSbgx_Ssu3ge8ihXd_38c Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:05:33.095750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef0ea55fd62446b8acc4051f02c4f053", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: adac9aca30e240ef80159f37adee7371 Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1722636479", "metadata": {"Type": "work"}}} Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: Jun 20 06:05:33.098177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1722636479', 'metadata': {'Type': 'work'}}}} Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi '0' Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:33.099258 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:05:33.101548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:05:33.102816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:05:33.102816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.102816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75672682-66c5-4185-99a8-0c62d3a6ece3 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:33.102816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-75672682-66c5-4185-99a8-0c62d3a6ece3 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010589 Jun 20 06:05:33.102816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 137/264] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 20 06:05:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:05:33.107419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6be9dcad-d2a1-41a2-a68e-64c0afed0756 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Action: 'create', calling method: .version_select at 0x7f9d442f70d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1771272382", "metadata": {"Type": "work"}}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6be9dcad-d2a1-41a2-a68e-64c0afed0756 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Request method failure captured: Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 119 Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA4sUgP4yxeIg_zM7oKh4ROSFmgMDTPBPZfNZZyv37KOx6aquVKtQxC2S3TTuOmkCzi7FG56MzACLiKSxHVKnCLYXjyP1ZObqfho37TE9Ht6WV5kgZxUudI5ZMn34-WDCfRmts44fV5LXfWsaToccv2P2CuSbgx_Ssu3ge8ihXd_38c Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:05:33.109755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef0ea55fd62446b8acc4051f02c4f053", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: adac9aca30e240ef80159f37adee7371 Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1771272382", "metadata": {"Type": "work"}}} Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: Jun 20 06:05:33.111175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1771272382', 'metadata': {'Type': 'work'}}}} Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi '' Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:33.112018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:05:33.113477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:05:33.114766 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:05:33.114766 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.114766 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6be9dcad-d2a1-41a2-a68e-64c0afed0756 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:33.114766 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6be9dcad-d2a1-41a2-a68e-64c0afed0756 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007693 Jun 20 06:05:33.114766 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 128/265] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 20 06:05:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:05:33.121972 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a35287ee-e7e8-491d-b666-3ff95f4a4b12 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Calling method '.version_select at 0x7f9d443c0160>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:33.152652 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-a35287ee-e7e8-491d-b666-3ff95f4a4b12 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] HTTP exception thrown: Volume tempest-invalid-515346415 could not be found. Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a35287ee-e7e8-491d-b666-3ff95f4a4b12 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Request method failure captured: Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-515346415 HTTP/1.1 Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA4sUgP4yxeIg_zM7oKh4ROSFmgMDTPBPZfNZZyv37KOx6aquVKtQxC2S3TTuOmkCzi7FG56MzACLiKSxHVKnCLYXjyP1ZObqfho37TE9Ht6WV5kgZxUudI5ZMn34-WDCfRmts44fV5LXfWsaToccv2P2CuSbgx_Ssu3ge8ihXd_38c Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:05:33.155463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef0ea55fd62446b8acc4051f02c4f053", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: adac9aca30e240ef80159f37adee7371 Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Volume tempest-invalid-515346415 could not be found. Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'tempest-invalid-515346415'} Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:33.156608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-515346415 could not be found. (HTTP 404) (Request-ID: req-63837dc4-96d9-4bd7-9796-ed684a1b333a) Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.157371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:05:33.158399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-515346415 could not be found. Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:33.159353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-515346415 could not be found. Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-515346415 could not be found. Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a35287ee-e7e8-491d-b666-3ff95f4a4b12 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Returning 404 to user: Volume tempest-invalid-515346415 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a35287ee-e7e8-491d-b666-3ff95f4a4b12 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-515346415" status: 404 len: 98 microversion: 2.1 time: 0.039321 Jun 20 06:05:33.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 138/266] 10.222.0.20 () {58 vars in 1214 bytes} [Mon Jun 20 06:05:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-515346415 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:05:33.171043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ccabb020-1397-4e20-a4b8-1f2329e9a770 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003881 Jun 20 06:05:33.171547 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 129/267] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jun 20 06:05:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 06:05:33.180338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5bdb8401-30ef-41a1-8ce3-c5d992052e19 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003728 Jun 20 06:05:33.180848 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 139/268] 10.222.0.20 () {58 vars in 1136 bytes} [Mon Jun 20 06:05:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 06:05:33.189812 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-85904eb8-c493-40fa-87a8-c6222ddcb667 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Calling method '.version_select at 0x7f9d442f5b80>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:33.222279 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-85904eb8-c493-40fa-87a8-c6222ddcb667 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] HTTP exception thrown: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-85904eb8-c493-40fa-87a8-c6222ddcb667 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Request method failure captured: Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/os-volumes/2a32d28e-97c6-4fe0-ad1a-a12df29bb446 HTTP/1.1 Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA4sUgP4yxeIg_zM7oKh4ROSFmgMDTPBPZfNZZyv37KOx6aquVKtQxC2S3TTuOmkCzi7FG56MzACLiKSxHVKnCLYXjyP1ZObqfho37TE9Ht6WV5kgZxUudI5ZMn34-WDCfRmts44fV5LXfWsaToccv2P2CuSbgx_Ssu3ge8ihXd_38c Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:05:33.226456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef0ea55fd62446b8acc4051f02c4f053", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: adac9aca30e240ef80159f37adee7371 Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '2a32d28e-97c6-4fe0-ad1a-a12df29bb446'} Jun 20 06:05:33.227729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. (HTTP 404) (Request-ID: req-feb26c14-0abb-41b0-9546-7e240e067a15) Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.228429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:05:33.229414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:05:33.230372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-85904eb8-c493-40fa-87a8-c6222ddcb667 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Returning 404 to user: Volume 2a32d28e-97c6-4fe0-ad1a-a12df29bb446 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-85904eb8-c493-40fa-87a8-c6222ddcb667 tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2a32d28e-97c6-4fe0-ad1a-a12df29bb446" status: 404 len: 109 microversion: 2.1 time: 0.042563 Jun 20 06:05:33.231369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 130/269] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:05:33 2022] DELETE /compute/v2.1/os-volumes/2a32d28e-97c6-4fe0-ad1a-a12df29bb446 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:05:33.240205 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2cefa409-dcc6-459b-bb29-ed6f941f24af tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Calling method '.version_select at 0x7f9d4440cee0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:33.266995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-2cefa409-dcc6-459b-bb29-ed6f941f24af tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] HTTP exception thrown: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2cefa409-dcc6-459b-bb29-ed6f941f24af tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Request method failure captured: Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/os-volumes/03ced3c6-ceb5-406d-917d-f154d6691bea HTTP/1.1 Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA4sUgP4yxeIg_zM7oKh4ROSFmgMDTPBPZfNZZyv37KOx6aquVKtQxC2S3TTuOmkCzi7FG56MzACLiKSxHVKnCLYXjyP1ZObqfho37TE9Ht6WV5kgZxUudI5ZMn34-WDCfRmts44fV5LXfWsaToccv2P2CuSbgx_Ssu3ge8ihXd_38c Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:05:33.268950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef0ea55fd62446b8acc4051f02c4f053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef0ea55fd62446b8acc4051f02c4f053", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ef0ea55fd62446b8acc4051f02c4f053 Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesNegativeTest-50538369 Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: adac9aca30e240ef80159f37adee7371 Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesNegativeTest-50538369-project Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '03ced3c6-ceb5-406d-917d-f154d6691bea'} Jun 20 06:05:33.270476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. (HTTP 404) (Request-ID: req-51864f30-0626-46cc-b596-bc64823c142e) Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.271336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:05:33.272882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:05:33.274104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2cefa409-dcc6-459b-bb29-ed6f941f24af tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] Returning 404 to user: Volume 03ced3c6-ceb5-406d-917d-f154d6691bea could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2cefa409-dcc6-459b-bb29-ed6f941f24af tempest-VolumesNegativeTest-50538369 tempest-VolumesNegativeTest-50538369-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/03ced3c6-ceb5-406d-917d-f154d6691bea" status: 404 len: 109 microversion: 2.1 time: 0.034891 Jun 20 06:05:33.275463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:05:33 2022] GET /compute/v2.1/os-volumes/03ced3c6-ceb5-406d-917d-f154d6691bea => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:05:33.742998 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:33.743866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:33.750906 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:33.751534 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:33.752581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:33.753283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:33.973661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:33.981543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6a13f12d-2fd9-4e6a-a400-3ea0f1fac9bf tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.242883 Jun 20 06:05:33.982210 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 131/271] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:33 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:34.997510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:35.002029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:35.026054 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:35.026674 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:35.027937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:35.028576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:35.223675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:35.231834 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2e5f0fe8-870b-41bf-9cee-df1cb3227417 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.238175 Jun 20 06:05:35.232396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 141/272] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:34 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:36.250601 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:36.251316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:36.262039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:36.262495 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:36.263389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:36.263824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:36.549229 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:36.556698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-663710d8-61ea-403e-a509-1142f0688a11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.310519 Jun 20 06:05:36.557291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 132/273] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:36 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:37.573365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:37.573968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:37.579918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:37.580361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:37.581140 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:37.581572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:37.951138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:37.958446 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-387edb35-b499-4253-8327-2af3f698e601 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.388912 Jun 20 06:05:37.959056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:37 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:38.976335 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:38.976871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:38.983391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:38.983833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:38.984575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:38.985033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:39.116305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:39.123720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8ee9e94c-590d-4072-8755-11e1fad0fd24 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.152066 Jun 20 06:05:39.124281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 133/275] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:38 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:40.140783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:40.141480 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:40.148626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:40.149300 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:40.150376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:40.150961 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:40.155451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:40.297386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:40.305617 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-65419d35-655a-43a9-becd-9bd2308e5ca6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.168746 Jun 20 06:05:40.315100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 143/276] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:40 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:41.322359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:41.322969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:41.329478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:41.329934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:41.330696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:41.331133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:41.349739 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:41.458360 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:41.466215 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0addacb9-6209-441a-b4f6-f8471fd62e4d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.147694 Jun 20 06:05:41.466782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 134/277] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:41 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:42.483523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:42.484051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:42.490072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:42.490531 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:42.491286 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:42.491722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:42.619543 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:42.627005 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f5b9fe0b-84b3-4ad4-a608-e8894848db61 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.147391 Jun 20 06:05:42.627557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 144/278] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:42 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:43.643794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:43.644562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:43.651016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:43.651459 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:43.652207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:43.652634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:43.780524 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:43.787899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d9e0350d-6758-40ad-9e43-59721253fe75 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.147986 Jun 20 06:05:43.788458 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 135/279] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:43 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:44.805332 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:44.805941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:44.811962 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:44.812411 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:44.813227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:44.813663 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:44.940002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:44.947382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-095ff010-01c8-420c-b728-3a530e128a52 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.146478 Jun 20 06:05:44.947949 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:44 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:45.964474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:45.965115 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:45.971481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:45.971933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:45.972726 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:45.973193 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:46.112115 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:46.119506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2acc30f1-5998-46dc-9a24-7cba709c2d77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.159547 Jun 20 06:05:46.120066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 136/281] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:45 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:47.136019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:47.136481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:47.142657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:47.143108 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:47.143878 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:47.144564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:47.277088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:47.284785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-73df44b0-e6d9-4a27-84fd-72770bcdfaf4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.152659 Jun 20 06:05:47.285382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 146/282] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:47 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:48.302108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:48.302709 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:48.310023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:48.310476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:48.311264 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:48.311698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:48.446070 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:48.453608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-974f67b5-a526-47ab-8e99-508e6e0336f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.155295 Jun 20 06:05:48.454241 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 137/283] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:48 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:49.470018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:49.470822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:49.476918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:49.477400 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:49.478169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:49.478607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:49.613799 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:49.622830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c72be159-c107-4d71-98c3-c54eeea0e26d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.156379 Jun 20 06:05:49.623694 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 147/284] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:49 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:05:50.640187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:50.640799 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:50.643258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:50.648685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:50.649148 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:50.649916 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:50.650355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:50.829399 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:50.840520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6d26d2c3-3ecb-41e9-b40f-0ae0ae6242a2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.204447 Jun 20 06:05:50.841118 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 138/285] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:50 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:51.857295 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:51.857902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:51.859988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=36 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:51.865892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:51.866341 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:51.867630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:51.868057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:52.012298 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:52.025912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1c15e281-b596-4602-98f1-dd7b2c6974bb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1522 microversion: 2.1 time: 0.172635 Jun 20 06:05:52.026481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 148/286] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:51 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:53.043819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:53.044677 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:53.053312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:53.053966 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:53.055316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:53.055900 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:53.195481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:53.202895 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-50f05e3e-4492-4cdf-8d19-67107303145a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1502 microversion: 2.1 time: 0.163412 Jun 20 06:05:53.203459 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 139/287] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:53 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:53.219386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:53.220028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:53.226900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:53.227350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:53.228113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:53.228548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:53.367354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:53.374827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9aca374e-ce56-486c-a914-1bf0bf98c884 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1516 microversion: 2.1 time: 0.159447 Jun 20 06:05:53.375382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 149/288] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:53 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:54.796145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:05:54.797992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:54.804520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:54.804965 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:54.805788 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:54.806221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:54.831146 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lazy-loading 'flavor' on Instance uuid a14b9a48-4cc1-4fb0-bc59-b22b124b5981 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:05:54.978169 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-279b8345-a047-4599-9994-61a0585e6ea9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/action" status: 200 len: 32 microversion: 2.1 time: 0.187106 Jun 20 06:05:54.979052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 140/289] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:05:54 2022] POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:05:54.989165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:54.989881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:54.997406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:54.998276 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:54.999059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:54.999490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:55.269955 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:55.281495 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c1abb8bd-a29f-4df7-9236-f8e5374222f1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.296657 Jun 20 06:05:55.295513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 150/290] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:54 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:56.303481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:56.305020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:56.311987 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:56.312666 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:56.313698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:56.314370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:56.463558 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:56.472200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e7b30f8b-00a1-4f4a-8816-024e7f894ea6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.173515 Jun 20 06:05:56.472771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 141/291] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:56 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:57.488598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:57.489271 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:57.495672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:57.496137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:57.496994 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:57.497520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:57.675381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:57.683514 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a6a407ab-35ed-4907-bdfd-f8132781bd29 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.198845 Jun 20 06:05:57.684675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 151/292] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:57 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:58.699875 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:58.700481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:58.707111 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:58.707768 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:58.708529 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:58.708962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:58.893039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:05:58.903543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-54d1af0c-fb8f-4537-b011-c1754d00f2f2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.207325 Jun 20 06:05:58.904490 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 142/293] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:58 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:59.921570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:59.922175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:05:59.930633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:59.931350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:05:59.932872 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:05:59.933508 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:00.106806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:00.114761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f49f7929-681b-44f2-81ba-7c51340a6464 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.197284 Jun 20 06:06:00.115470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 152/294] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:05:59 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:01.132667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:01.133652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:01.142585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:01.143043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:01.143815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:01.144508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:01.305953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:01.316120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ace46377-039d-4617-af44-5b5337fab7c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.185405 Jun 20 06:06:01.316120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 143/295] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:01 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:02.330600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:02.331273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:02.338079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:02.338530 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:02.339292 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:02.339726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:02.472005 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:02.479309 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e2fba08b-6bfe-4ebe-8e72-985b0c07a0cb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.153312 Jun 20 06:06:02.479867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 153/296] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:02 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:03.495308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:03.495910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:03.502199 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:03.502643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:03.503391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:03.503818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:03.635759 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:03.643145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-207f3415-ceca-4569-9682-32711d53321b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.151585 Jun 20 06:06:03.643713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:03 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:04.660094 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:04.660626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:04.666839 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:04.667354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:04.668071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:04.668502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:04.797774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:04.805603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d5b5e0c5-93fd-4a27-a62b-49544349991c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.149405 Jun 20 06:06:04.806160 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 154/298] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:04 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:05.822616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:05.823175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:05.829021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:05.829470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:05.830225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:05.830655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:05.964442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:05.972035 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d8f9bc1c-ed46-4a87-a880-8f29e7ee14fa tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.153943 Jun 20 06:06:05.972621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 145/299] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:05 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:06.988843 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:06.989486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:06.995450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:06.995897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:06.996651 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:06.997107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:07.126520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:07.134597 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f8beae70-b2ca-4945-902d-d3771f95058b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.149479 Jun 20 06:06:07.135168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 155/300] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:06 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:08.152391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:08.153119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:08.160223 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:08.160904 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:08.161716 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:08.162160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:08.304589 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:08.312142 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fd8af0fa-3461-4e1e-91f5-0b2a1f0816e3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.164247 Jun 20 06:06:08.312861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 146/301] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:08 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:09.330079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:09.331349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:09.340060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:09.340760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:09.341560 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:09.341997 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:09.474150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:09.482171 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1009db03-029f-45aa-9c72-b8a820a19356 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.155876 Jun 20 06:06:09.482727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 156/302] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:09 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:10.500094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:10.500848 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:10.508785 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:10.509273 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:10.510040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:10.510631 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:10.646397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:10.655100 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-95acad12-20f8-4dd8-9e02-b8ca10c362f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.159405 Jun 20 06:06:10.655682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 147/303] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:10 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:10.876958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2085400894", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "networks": [{"uuid": "64bdea2b-1141-4954-8ef3-c8d6f86f89d0"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:10.934785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] validate_networks() for [('64bdea2b-1141-4954-8ef3-c8d6f86f89d0', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:06:11.304565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:06:11.305054 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:06:11.305531 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:06:11.305963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:06:11.306377 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:06:11.322819 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:11.323274 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:11.324103 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:11.324613 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:11.338712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=83 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:11.349778 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Getting quotas for project 6ef63de6229c418f8fa2dd4c988e5855. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:06:11.354593 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Getting quotas for user 576d70d0517045fca9fbff6eaa846183 and project 6ef63de6229c418f8fa2dd4c988e5855. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:06:11.365795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:06:11.368097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:06:11.416551 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7f2f09da-b56f-4edf-91df-b0f4545e1031 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543332 Jun 20 06:06:11.417400 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 157/304] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:06:11.427615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5022ee18-9a21-4369-b13c-d26b0e58fe94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:11.428170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5022ee18-9a21-4369-b13c-d26b0e58fe94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:11.487812 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5022ee18-9a21-4369-b13c-d26b0e58fe94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:11.494692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5022ee18-9a21-4369-b13c-d26b0e58fe94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1219 microversion: 2.1 time: 0.071450 Jun 20 06:06:11.495752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 148/305] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:11 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:11.673179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:11.674270 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:11.682255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:11.683381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:11.684872 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:11.685528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:11.865057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:11.874320 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d089f5ac-796d-47f2-beb9-7350177ea888 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.205549 Jun 20 06:06:11.878405 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 158/306] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:11 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:12.513389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:12.514006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:12.525598 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:12.526046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:12.526818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:12.527414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:12.530383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:12.616777 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:12.625679 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4fe85267-c43c-42cc-bcde-0960d61c4367 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1271 microversion: 2.1 time: 0.117364 Jun 20 06:06:12.626400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 149/307] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:12 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:12.895907 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:12.896622 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:12.903088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:12.903701 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:12.904864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:12.905378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:13.156532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:13.165344 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-df941271-1887-4343-b8cb-6b70f4516afe tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.273304 Jun 20 06:06:13.165924 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 159/308] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:12 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:13.644799 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:13.645763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:13.654555 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:13.655442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:13.656363 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:13.656948 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:13.909963 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:13.929595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-12803a37-7fec-42bc-91f5-2dc06eec4dcd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.287517 Jun 20 06:06:13.931469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 150/309] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:13 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:14.182958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:14.184408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:14.190679 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:14.191365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:14.192337 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:14.192768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:14.386012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:14.394716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-922600d6-6ec6-4305-b0a0-8aed24dff915 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.215609 Jun 20 06:06:14.395852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 160/310] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:14 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:14.840895 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-077a5619-f28a-4a58-b1a6-24f5bed7cc07 req-1a0d80f3-fc41-4717-b05e-4ab707273177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d584cd-f025-4437-9cf6-f3eab8a6a641", "tag": "069375a9-c8c2-45c9-a048-4950477315c7"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:14.854723 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-077a5619-f28a-4a58-b1a6-24f5bed7cc07 req-1a0d80f3-fc41-4717-b05e-4ab707273177 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:14.855637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-077a5619-f28a-4a58-b1a6-24f5bed7cc07 req-1a0d80f3-fc41-4717-b05e-4ab707273177 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:14.885961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-077a5619-f28a-4a58-b1a6-24f5bed7cc07 req-1a0d80f3-fc41-4717-b05e-4ab707273177 service nova] Creating event network-changed:069375a9-c8c2-45c9-a048-4950477315c7 for instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 on hv-cinder-83699 Jun 20 06:06:14.901755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-077a5619-f28a-4a58-b1a6-24f5bed7cc07 req-1a0d80f3-fc41-4717-b05e-4ab707273177 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064634 Jun 20 06:06:14.903182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 151/311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:14.948346 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:14.949244 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:14.960484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:14.961268 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:14.962541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:14.963129 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:15.210608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:15.230040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9e429321-2464-4548-844f-b79a123c7e24 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.285737 Jun 20 06:06:15.230624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 161/312] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:14 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:15.417390 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:15.418410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:15.426871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:15.427884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:15.432196 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:15.433506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:15.512051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:15.513459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:15.525710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:15.526424 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:15.527262 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:15.527701 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:15.560549 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4efdc317-fa05-4258-9a82-e4e3ab8c900b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/ips" status: 200 len: 146 microversion: 2.1 time: 0.057997 Jun 20 06:06:15.561820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 162/313] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:06:15 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/ips => generated 146 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:15.793491 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:15.807733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fdf6309a-aeff-4545-ad86-de8d288626e6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.398497 Jun 20 06:06:15.808650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 152/314] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:15 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:16.253664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:16.254791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:16.262282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:16.262731 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:16.263682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:16.264118 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:16.495284 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:16.504113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c3bb9575-7c01-4553-9d40-04d4a863e6e6 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.256853 Jun 20 06:06:16.506484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 163/315] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:16 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:16.826449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:16.829457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:16.863930 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:16.864605 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:16.865596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:16.869051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:17.480053 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:17.488531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2f685c22-9791-4c3b-8119-81f991e4c115 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.666270 Jun 20 06:06:17.489486 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 153/316] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:16 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:17.523033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:17.523724 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:17.534347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:17.536754 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:17.537409 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:17.540062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:17.757982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:17.767573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-856abd27-43cd-4c68-bd4e-d9c447b64f67 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.249539 Jun 20 06:06:17.769804 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 164/317] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:17 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:18.518325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:18.519642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:18.552253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:18.559175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:18.564140 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:18.570198 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:18.786306 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:18.787190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:18.801033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:18.801646 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:18.804082 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:18.806489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:18.916242 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:18.927303 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-62dd65eb-084d-4524-a595-670632b3d273 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.424505 Jun 20 06:06:18.946443 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 154/318] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:18 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:19.127190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:19.139028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-30043020-105a-4ed7-bee4-6fb5fa2e24f4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.356900 Jun 20 06:06:19.140119 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 165/319] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:18 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:19.700922 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b34b46a5-3010-47fc-9ff0-436142bcf7cf"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:19.702064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:19.709271 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:19.709814 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:19.716942 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:19.717424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:19.718211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:19.718646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:19.719130 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:19.719637 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:19.729018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:19.729630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:19.778974 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1558f0cb-7490-43c0-901f-ac62f45dd53c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/ips" status: 200 len: 151 microversion: 2.20 time: 0.073818 Jun 20 06:06:19.785662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 166/320] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jun 20 06:06:19 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/ips => generated 151 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:06:19.947285 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:19.948846 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:19.961852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:19.962739 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:19.963687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:19.967233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:20.487015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:20.499175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3f646423-7e6b-4f1c-b9fd-45e748acf5ee tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.556353 Jun 20 06:06:20.500233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 167/321] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:19 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:20.514533 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:20.515069 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:20.523900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:20.524359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:20.525187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:20.525629 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:20.792523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:20.803596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c88cd145-5195-4e8e-b579-ff2795b346d7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.301990 Jun 20 06:06:20.809516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 168/322] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:20 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:21.492057 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:21.516213 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:21.517598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:21.524123 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:21.527866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:21.545860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:21.556009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:21.557722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:21.559422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:21.947234 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:21.957561 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6d789b6a-1374-4161-b83f-10b8ce4e6f90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.442725 Jun 20 06:06:21.958648 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 169/323] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:21 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:21.974159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:21.979348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:21.981305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:21.987315 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:21.987900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:21.989037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:21.989689 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:22.238566 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:22.253941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a57d200f-d899-45d0-90df-dda10e3c5072 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.293324 Jun 20 06:06:22.254526 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 170/324] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:21 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:23.144560 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-21a85bc3-d22f-4b30-aefb-d15512368870 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.447958 Jun 20 06:06:23.146190 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 155/325] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:06:19 2022] POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-volume_attachments => generated 194 bytes in 3451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:23.158212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:23.160912 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:23.163120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=38 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:23.171178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.171638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.172566 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.173018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.275625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-67304a86-2018-4e9b-9fe9-086726c1d7d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Action: 'create', calling method: .version_select at 0x7f9d4440ca60>, body: {"keypair": {"name": "tempest-TestShelveInstance-178333891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDShRJIBfHlm62PUfEB9k8Sms2wclvcLcl4CIfaNKZj4b6read7D/pPYCczf3zlZGFYiXG9o/gqwJpmdzpLI0AreQi7w+WKaSlit1Lz2YH6UKX0o0+0+9lXnEo6gJWHZuQ=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:23.308988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-67304a86-2018-4e9b-9fe9-086726c1d7d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Getting quotas for project c2faf73842cb4faabb12f920b54bbcb7. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:06:23.314421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-67304a86-2018-4e9b-9fe9-086726c1d7d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Getting quotas for user a99817225e5d420880fe221b74c22518 and project c2faf73842cb4faabb12f920b54bbcb7. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:06:23.358349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-67304a86-2018-4e9b-9fe9-086726c1d7d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.388577 Jun 20 06:06:23.359590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 171/326] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:06:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:06:23.378744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:23.379374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:23.390971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.391425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.398401 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.399049 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.450905 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:23.462373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ada67ae6-5a9b-42a5-b501-7750ed2f7bc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1502 microversion: 2.1 time: 0.314409 Jun 20 06:06:23.465279 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 156/327] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:23 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:23.480489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66b4a457-9c8e-4684-a19a-201c862b9408"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:23.481641 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:23.494059 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.494410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.496857 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.499504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.544460 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] HTTP exception thrown: Cannot 'attach_volume' instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 while it is in vm_state rescued Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Request method failure captured: Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/os-volume_attachments HTTP/1.1 Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 74 Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3LRl1N6uEvDYwQuC6yEi4EhK2Gn9ZOqOdHje-XDHNZAHEpuUJOukpHa9DFYPYBG_T9C_zv16TCg_z6QtDi9oFzx4J5MS09goz5s9iPGd1zEFHqocpo_RYa9_1eWhdY4EPJ15pkD9E_Ko5fIoO4PbLX4JhABhkN_frtXvy2sb57wYo Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:06:23.546910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0927cd2db94bbfb6155990aef06aa0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 0db0333f0ea245539f27e0d8f27daca3 Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {"volumeAttachment": {"volumeId": "66b4a457-9c8e-4684-a19a-201c862b9408"}} Jun 20 06:06:23.548253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Cannot 'attach_volume' instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 while it is in vm_state rescued Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'server_id': 'a14b9a48-4cc1-4fb0-bc59-b22b124b5981', 'body': {'volumeAttachment': {'volumeId': '66b4a457-9c8e-4684-a19a-201c862b9408'}}} Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:06:23.549016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 while it is in vm_state rescued Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:06:23.550299 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:06:23.551430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:06:23.551430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:06:23.551430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 while it is in vm_state rescued Jun 20 06:06:23.551430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:06:23.552616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Returning 409 to user: Cannot 'attach_volume' instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 while it is in vm_state rescued {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:06:23.554208 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8ae8b7e4-fc0f-4af3-8f08-ec947d2f3861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077986 Jun 20 06:06:23.554780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 157/328] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:06:23 2022] POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:06:23.568015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:23.569407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:23.576610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.577757 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.579329 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.579961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.631767 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:23.641126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a1c75e1c-e5fe-4ee6-b848-f37823a713eb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.280015 Jun 20 06:06:23.642066 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 172/329] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:23 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:23.674699 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ba1de235-ff0c-4047-af71-bc8a24d6d6f5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/action" status: 202 len: 0 microversion: 2.1 time: 0.114065 Jun 20 06:06:23.676651 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 158/330] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:06:23 2022] POST /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:06:23.688822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:23.689910 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:23.698399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.699563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:23.700481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:23.701942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.064632 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:24.074930 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-999d5e5c-7960-4cca-9ff0-41b8e2cdad90 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1510 microversion: 2.1 time: 0.390519 Jun 20 06:06:24.076306 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 173/331] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:23 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:24.307822 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:24.309893 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:24.321687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.327375 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.328498 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.329248 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.361637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lazy-loading 'flavor' on Instance uuid e69f0c75-8247-4de3-9021-72428abdf335 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:06:24.658859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:24.659541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:24.674723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.675581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.676760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.677446 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.845581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cc2e1365-5c2d-48f1-bdba-d3e22f3ef01f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/action" status: 202 len: 0 microversion: 2.20 time: 0.546708 Jun 20 06:06:24.846645 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 159/332] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 20 06:06:24 2022] POST /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:06:24.852383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-0a94b13f-37dc-4b92-b68b-6e301d951253 req-349cf1df-863b-492c-9020-8ba733b969ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d584cd-f025-4437-9cf6-f3eab8a6a641", "name": "network-vif-plugged", "status": "completed", "tag": "069375a9-c8c2-45c9-a048-4950477315c7"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:24.879222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-0a94b13f-37dc-4b92-b68b-6e301d951253 req-349cf1df-863b-492c-9020-8ba733b969ed service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.887689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-0a94b13f-37dc-4b92-b68b-6e301d951253 req-349cf1df-863b-492c-9020-8ba733b969ed service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.915682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-0a94b13f-37dc-4b92-b68b-6e301d951253 req-349cf1df-863b-492c-9020-8ba733b969ed service nova] Creating event network-vif-plugged:069375a9-c8c2-45c9-a048-4950477315c7 for instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 on hv-cinder-83699 Jun 20 06:06:24.931013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-0a94b13f-37dc-4b92-b68b-6e301d951253 req-349cf1df-863b-492c-9020-8ba733b969ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082778 Jun 20 06:06:24.931608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 160/333] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:24.940021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:24.940715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:24.960938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.965473 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:24.966545 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:24.967356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:25.007797 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:25.018490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-92c36f1f-88d3-4fe7-9864-0baf44d3fbfe tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.363011 Jun 20 06:06:25.025212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 174/334] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:24 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:25.096146 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:25.096823 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:25.111638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:25.112136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:25.115277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:25.115828 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:25.267314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:25.278917 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:25.280887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:25.282215 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8e015484-f96d-4384-8dc1-beee06891b37 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.348732 Jun 20 06:06:25.300135 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 161/335] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:24 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:25.386995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:25.396141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4bd7ad54-9d40-4f1d-99de-09e103cd7421 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1510 microversion: 2.1 time: 0.304127 Jun 20 06:06:25.408279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 175/336] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:25 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:26.035931 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:26.036543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:26.043642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:26.044090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:26.044853 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:26.045346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:26.182762 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:26.190448 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2686523d-ce11-4353-8664-342882aac2a4 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.158243 Jun 20 06:06:26.190996 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 162/337] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:26 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:26.299541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:26.300218 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:26.306509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:26.306963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:26.307736 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:26.308171 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:26.311045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:26.416356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:26.416899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:26.423995 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:26.424445 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:26.425372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:26.425956 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:26.428766 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:26.448429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:26.456475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:26.458006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:26.459705 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2d44b3d2-5493-4b5b-844d-846d8c8e35cc tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.163503 Jun 20 06:06:26.460809 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 176/338] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:26 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:26.638719 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:26.653307 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a7c2bb56-48d3-43fb-9ebf-e8cf82713244 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1510 microversion: 2.1 time: 0.241077 Jun 20 06:06:26.654607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 163/339] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:26 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:27.207577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:27.208230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:27.214350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:27.214811 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:27.215578 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:27.216047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:27.355862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:27.363740 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-96c7e4ca-da79-4981-9090-4d7edf692533 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.160415 Jun 20 06:06:27.364349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 177/340] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:27 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:27.478499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:27.479851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:27.486368 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:27.486820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:27.487585 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:27.488018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:27.648528 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:27.661485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:27.663540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:27.666127 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-72bea665-ac7e-40ab-8363-4c2cbd90faaa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.190956 Jun 20 06:06:27.666127 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 164/341] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:27 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:27.671059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:27.671664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:27.680265 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:27.680707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:27.681502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:27.681952 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:27.929893 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:27.940414 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7eba724d-f54c-4703-8529-ae38964ea6c0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1516 microversion: 2.1 time: 0.272920 Jun 20 06:06:27.945072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 178/342] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:27 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:28.382763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:28.383772 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:28.391777 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:28.392306 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:28.393293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:28.393761 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:28.535254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:28.543501 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-25e8c62d-0177-401a-90b9-806a964294e1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1319 microversion: 2.1 time: 0.165013 Jun 20 06:06:28.544080 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 165/343] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:28 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:28.682662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:28.683974 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:28.690161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:28.690604 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:28.691368 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:28.691884 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:28.874335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:28.884053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:28.886444 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:28.888480 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-957a71f4-1eb5-4d83-a873-8e7138e2a685 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.210599 Jun 20 06:06:28.889316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 179/344] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:28 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:29.360936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1326edba-2939-4efb-bfce-aa6985198f0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'create', calling method: .version_select at 0x7f9d442f0c10>, body: {"keypair": {"name": "tempest-keypair-863749973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtRbBei0TnJKuV38BLDfT0WJIblBKt7RtQJWcVCYEjSDJ6uIOrPyzaVRBM8OgCVU4ygul4Y7js2bMEvIUPMBkPir3T4ZOsLKPEMsnrTS1MCMAayUeQ/JvTAmGvMrW+yvg=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:29.377794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-1326edba-2939-4efb-bfce-aa6985198f0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:06:29.381902 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-1326edba-2939-4efb-bfce-aa6985198f0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for user 0db0333f0ea245539f27e0d8f27daca3 and project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:06:29.408637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1326edba-2939-4efb-bfce-aa6985198f0a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051773 Jun 20 06:06:29.409413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 166/345] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:06:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:29.560910 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:29.561882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:29.570385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:29.570965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:29.572011 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:29.572549 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:29.912843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:29.914537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:29.925098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:29.925818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:29.926817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:29.927430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:29.942245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:29.971783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e32b936f-7918-450d-a0b3-2f6c28480073 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1506 microversion: 2.1 time: 0.415702 Jun 20 06:06:29.972410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 180/346] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:29 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:30.124531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:30.140935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:30.142611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:30.146071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fa4cd6f7-fc65-4ff6-8379-20b313e69166 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.239563 Jun 20 06:06:30.158066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 167/347] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:29 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:30.979388 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b2eb238b-9527-4227-94d5-2305beb403cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:30.985547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2eb238b-9527-4227-94d5-2305beb403cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:30.985998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2eb238b-9527-4227-94d5-2305beb403cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:31.059395 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b2eb238b-9527-4227-94d5-2305beb403cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Going to try to stop instance {{(pid=117666) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 06:06:31.166410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:31.167859 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:31.176192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:31.176679 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:31.177583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:31.178026 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:31.247995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b2eb238b-9527-4227-94d5-2305beb403cf tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action" status: 202 len: 0 microversion: 2.1 time: 0.272548 Jun 20 06:06:31.248771 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 181/348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:06:30 2022] POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:06:31.257686 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:31.258765 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:31.266000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:31.266834 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:31.268174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:31.269696 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:31.387669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:31.396495 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:31.399142 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:31.400417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cd401c57-15c5-45c9-8314-0850938a1ac8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.239000 Jun 20 06:06:31.401338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 168/349] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:31 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:31.412677 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-479235344", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c78fcbc-665a-466f-b9ff-c9c04fb72740"}], "security_groups": [{"name": "tempest-securitygroup--1142756546"}], "key_name": "tempest-keypair-863749973", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:31.446626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:31.454782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2df09518-9a53-4854-98db-b901e6f885cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.201873 Jun 20 06:06:31.455328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 182/350] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:31 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:32.417879 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:32.418553 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:32.424414 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:32.424857 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:32.425627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:32.426057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:32.560539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:32.569763 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:32.571287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:32.572450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-33166af0-2733-4ca7-8d53-10d63fc305a7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.158440 Jun 20 06:06:32.573046 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 183/351] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:32 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:32.577310 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:32.577910 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:32.584059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:32.585161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:32.585926 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:32.586365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:32.722359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:32.731626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d9f39803-0825-4d37-8674-223b2a0d1f07 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.157515 Jun 20 06:06:32.732448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 184/352] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:32 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:33.590665 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:33.591333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:33.593249 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=4 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:33.598572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:33.599028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:33.599789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:33.600730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:33.739137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:33.746965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:33.748517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:33.749664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a4462d39-b446-4a8d-aaca-6735a6737635 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.162957 Jun 20 06:06:33.750212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 185/353] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:33 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:33.754735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:33.755338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:33.761112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:33.761576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:33.762348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:33.762790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:33.896256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:33.904735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5a75c7d6-e771-4f64-ab11-8a11505e99ca tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.153465 Jun 20 06:06:33.905303 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 186/354] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:33 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:34.767828 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:34.768430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:34.775982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:34.776409 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:34.777461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:34.777897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:34.916287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:34.924182 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:34.925722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:34.926871 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c25af7ca-4d56-4a07-a067-a11e841b695a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.162957 Jun 20 06:06:34.927437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 187/355] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:34 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:34.932743 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:34.933396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:34.939275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:34.939725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:34.940482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:34.940917 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:35.073872 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:35.081822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d7a7a3fe-dd79-4a32-98f4-3965fb8b66dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.153454 Jun 20 06:06:35.084834 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 188/356] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:34 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:35.945571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:35.946338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:35.952297 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:35.952755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:35.953551 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:35.953985 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:36.091393 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:36.099284 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:36.100855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:36.102069 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-541c2f56-fbfa-4628-9b5e-1e1486559f58 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.161407 Jun 20 06:06:36.102660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 189/357] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:35 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:36.107107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:36.107738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:36.113306 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:36.113766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:36.114527 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:36.114971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:36.245353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:36.254198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-335d0207-9f3a-4370-91b7-008c85ef5d12 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.150470 Jun 20 06:06:36.254784 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 190/358] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:36 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:37.120384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:37.121024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:37.126978 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:37.127431 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:37.128196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:37.128633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:37.261541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:37.264104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:37.272913 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:37.274442 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:37.275607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9d59353d-8fd5-4304-b325-1731f97796a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.159145 Jun 20 06:06:37.277063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 191/359] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:37 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:37.285168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:37.285168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:37.289875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:37.290332 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:37.291114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:37.291556 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:37.434545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:37.442394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-61d6e196-2097-466f-a982-5fb4976eb4eb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.164065 Jun 20 06:06:37.442953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 192/360] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:37 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:38.293864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:38.294541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:38.301090 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:38.301548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:38.302360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:38.302825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:38.434029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:38.442153 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:38.444511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:38.445654 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a314ed50-6f70-46e3-90a8-fdc4016fff6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.155938 Jun 20 06:06:38.446219 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 193/361] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:38 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:38.459753 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:38.460354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:38.466442 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:38.466888 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:38.467636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:38.468061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:38.606656 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:38.614590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-42616914-6320-49bb-ab25-c6e2aab12822 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.158703 Jun 20 06:06:38.615143 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 194/362] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:38 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:39.388874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:39.465135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:39.465852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:39.472949 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:39.473425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:39.474192 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:39.474623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:39.601827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:39.610053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:39.611561 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:39.612718 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8f1af0e7-fb5b-40cd-a8d1-a08f1d33c3a3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.152158 Jun 20 06:06:39.613308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 195/363] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:39 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:39.633147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:39.633761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:39.640021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:39.640478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:39.641282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:39.641727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:39.780386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:39.788592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-263ef193-478d-4066-bf88-76130fbcdbb9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.159763 Jun 20 06:06:39.789183 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 196/364] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:39 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:40.630891 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:40.631522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:40.637549 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:40.638003 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:40.638763 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:40.639203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:40.773819 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:40.781717 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:40.783217 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:40.784411 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a461c3db-dc0f-45fe-9b8a-267fca82b6eb tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.157415 Jun 20 06:06:40.784941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 197/365] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:40 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:40.805440 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:40.806118 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:40.812785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:40.813380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:40.814291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:40.814733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:40.947647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:40.957344 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-373d71a9-4aad-4349-9ced-aa1a33f5c8f8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.155612 Jun 20 06:06:40.958104 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 198/366] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:40 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:41.392103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=29 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:41.421957 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:41.804413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:41.805079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:41.811002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:41.811445 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:41.812199 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:41.812626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:41.949705 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:41.957629 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:41.959699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:41.961139 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2332d68c-20e3-4103-8ea4-b8376ad2268f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1744 microversion: 2.20 time: 0.160947 Jun 20 06:06:41.961968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 199/367] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:41 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:41.977061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:41.977677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:41.983793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:41.984246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:41.985034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:41.985476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:42.114091 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:42.122069 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d7be02d1-d7a9-4f85-860e-891aeb00b114 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.149371 Jun 20 06:06:42.122748 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 200/368] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:41 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:42.979666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:42.980311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:42.986294 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:42.986736 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:42.987491 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:42.987920 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:43.125913 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:43.133719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:43.135292 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:43.136500 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bc56d608-c6ef-4a3d-92d4-5507298f5a8b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1744 microversion: 2.20 time: 0.160669 Jun 20 06:06:43.137068 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 201/369] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:42 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:43.141461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:43.142053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:43.148273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:43.148732 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:43.149878 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:43.150376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:43.284546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:43.294116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-56650f4c-7dbd-4555-a65f-fe357867c854 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.156063 Jun 20 06:06:43.294684 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 202/370] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:43 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:43.385862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] validate_networks() for [('2c78fcbc-665a-466f-b9ff-c9c04fb72740', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:06:43.789582 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:06:43.790002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:06:43.790472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:06:43.790883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:06:43.791292 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:06:43.800231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:43.800751 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:43.801637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:43.802149 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:43.820016 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:06:43.823932 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Getting quotas for user 0db0333f0ea245539f27e0d8f27daca3 and project 3f0927cd2db94bbfb6155990aef06aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:06:43.834773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:06:43.837105 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:06:43.883570 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-797e73ed-a985-43a2-9257-344b68b10f35 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.480980 Jun 20 06:06:43.884208 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 169/371] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:06:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 12482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:06:43.894038 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d9805c61-aa5d-448d-b2ab-d69073a86c3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:43.894909 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d9805c61-aa5d-448d-b2ab-d69073a86c3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:43.948516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d9805c61-aa5d-448d-b2ab-d69073a86c3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:43.955114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d9805c61-aa5d-448d-b2ab-d69073a86c3e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1244 microversion: 2.1 time: 0.064882 Jun 20 06:06:43.955681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 203/372] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:43 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1244 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:44.155004 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:44.155631 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:44.163351 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.163815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:44.164597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.165113 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:44.311816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:44.312456 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:44.319194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.319856 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:44.320787 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.321246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:44.333570 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:44.341932 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:44.343488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:44.344656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c72ceeca-b9e1-4ddc-adb9-ae6817e1317b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1744 microversion: 2.20 time: 0.193855 Jun 20 06:06:44.345265 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 170/373] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:44 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:44.451715 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:44.460230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0f7ca10c-a803-4b60-9ed2-5c985a58fa81 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.152342 Jun 20 06:06:44.460832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 204/374] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:44 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:44.729533 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-b0253ca1-f55c-4315-ab88-bcca52369081 req-0e9f69df-77c3-4db1-b84d-ed9a9075447f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "name": "network-vif-plugged", "status": "completed", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:44.749587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b0253ca1-f55c-4315-ab88-bcca52369081 req-0e9f69df-77c3-4db1-b84d-ed9a9075447f service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.750168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b0253ca1-f55c-4315-ab88-bcca52369081 req-0e9f69df-77c3-4db1-b84d-ed9a9075447f service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:44.771962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-b0253ca1-f55c-4315-ab88-bcca52369081 req-0e9f69df-77c3-4db1-b84d-ed9a9075447f service nova] Creating event network-vif-plugged:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:06:44.777578 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-b0253ca1-f55c-4315-ab88-bcca52369081 req-0e9f69df-77c3-4db1-b84d-ed9a9075447f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051201 Jun 20 06:06:44.778614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 171/375] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:44.971619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:44.972138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:44.978839 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.979280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:44.980028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:44.980455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:45.042681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:45.055897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ee2b593d-5a28-49f9-b3a9-a5c6a75a1a85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1296 microversion: 2.1 time: 0.088100 Jun 20 06:06:45.056526 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 205/376] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:44 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:45.363752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:45.364733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:45.371655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:45.372104 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:45.372865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:45.373331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:45.477636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:45.478391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:45.484315 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:45.484761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:45.485572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:45.486005 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:45.602349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:45.610209 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:45.611801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:45.613054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5d55dee3-d335-4324-8954-13b30722b281 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.253518 Jun 20 06:06:45.613932 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 172/377] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:45 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:45.743963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:45.752384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f5762295-20f2-429b-9b9d-3cb0f24df7ed tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.278507 Jun 20 06:06:45.763376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 206/378] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:45 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:46.073522 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:46.074221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:46.082934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:46.083388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:46.084281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:46.084872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:46.290333 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:46.297844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-22c8833d-b461-46e2-a9a9-e6f87e72039d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.228824 Jun 20 06:06:46.298669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 173/379] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:46 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:46.631592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:46.632212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:46.640285 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:46.640285 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:46.640285 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:46.642788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:46.770737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:46.771718 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:46.780376 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:46.781607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:46.782773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:46.783003 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:46.873641 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:46.884932 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:46.886478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:46.887820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fe7b13e4-8647-4b9d-abaa-6ecbd105c79f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.260837 Jun 20 06:06:46.888405 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 207/380] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:46 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:47.042214 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:47.058626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-8fbd1f30-3056-4318-88c9-f7cbd9a7838e req-780416fa-4450-45e9-9dcb-100d490a8219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d7331f-1d20-4a2e-b520-5a6d8a45d112", "tag": "5ebb7e6b-277b-4d1f-9454-0ec64cd2a770"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:47.059403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-32987ecc-ab48-43ce-84a6-e4e425f2c443 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.292596 Jun 20 06:06:47.073202 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 174/381] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:46 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:47.076681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-8fbd1f30-3056-4318-88c9-f7cbd9a7838e req-780416fa-4450-45e9-9dcb-100d490a8219 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:47.077245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-8fbd1f30-3056-4318-88c9-f7cbd9a7838e req-780416fa-4450-45e9-9dcb-100d490a8219 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:47.091027 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-8fbd1f30-3056-4318-88c9-f7cbd9a7838e req-780416fa-4450-45e9-9dcb-100d490a8219 service nova] Creating event network-changed:5ebb7e6b-277b-4d1f-9454-0ec64cd2a770 for instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 on hv-cinder-83699 Jun 20 06:06:47.096214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-8fbd1f30-3056-4318-88c9-f7cbd9a7838e req-780416fa-4450-45e9-9dcb-100d490a8219 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053916 Jun 20 06:06:47.097058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 208/382] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:47.317449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:47.318065 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:47.324721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:47.325219 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:47.325998 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:47.326439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:47.526416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:47.533886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-48eebca1-9bb4-452d-a21f-4268c65f8fe1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.220541 Jun 20 06:06:47.534450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 175/383] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:47 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:47.908868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:47.909931 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:47.923542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:47.924091 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:47.926116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:47.926116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:48.081629 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:48.082741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:48.091725 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:48.092280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:48.093086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:48.093542 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:48.534423 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:48.542775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:48.544240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:48.545541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-820d7660-e1f6-4919-81b1-60a5efdb4221 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.642159 Jun 20 06:06:48.546391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 209/384] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:47 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:48.551501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:48.552105 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:48.558021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:48.558470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:48.559229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:48.559665 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:48.563956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:48.659730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:48.667925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b6c7a0a7-3f18-44e2-ae66-565b9ed916b9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.593268 Jun 20 06:06:48.668496 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 176/385] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:48 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:48.768772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:48.776759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a6b1cc66-fd64-4aff-8323-89a08ae126f3 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.229229 Jun 20 06:06:48.777443 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 210/386] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:48 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:49.563422 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:49.564024 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:49.570415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:49.570860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:49.571604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:49.572038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:49.685019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:49.685630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:49.691572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:49.692018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:49.692769 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:49.693224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:49.699205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:49.707969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:49.710010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:49.711185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dd792b1f-0cb3-4509-83b4-391d87d507b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.151691 Jun 20 06:06:49.711750 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 177/387] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:49 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:49.794156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:49.794797 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:49.800734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:49.801222 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:49.801997 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:49.802436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:49.826602 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:49.835127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-08fa5189-4be6-4d49-9483-dcffecad01b4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.153913 Jun 20 06:06:49.835686 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 211/388] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:49 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:49.933221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:49.940477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-37be5196-f3ce-416f-86b5-05931d552752 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.150194 Jun 20 06:06:49.941091 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 178/389] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:49 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:50.729847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:50.731308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:50.738549 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:50.739317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:50.740358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:50.741193 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:50.853821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:50.854596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:50.862967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:50.863425 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:50.868539 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:50.869045 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:50.951838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:50.961528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:50.963372 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:50.965214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a7490ea4-b00b-447b-82a5-e7a7f030a462 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.239371 Jun 20 06:06:50.966362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 212/390] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:50 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:50.971113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:50.971979 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:50.978545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:50.979295 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:50.980131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:50.980764 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:51.084602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:51.097239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a6a01a63-9611-4ea4-bbaf-ba9d36f4b931 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.245204 Jun 20 06:06:51.112690 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 179/391] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:50 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:51.166624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:51.176239 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b4350957-d8e3-43b2-97fb-355037817ce8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.208557 Jun 20 06:06:51.176943 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 213/392] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:50 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:51.983893 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:51.984684 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:51.991580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:51.992430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:51.993428 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:51.994084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:52.114725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:52.117193 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:52.122735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:52.125144 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:52.125990 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:52.127541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:52.128185 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:52.157349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:52.168898 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:52.172455 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:52.180937 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c9e7a378-2cbf-41c6-afc2-a1fb75c8a374 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.201132 Jun 20 06:06:52.181758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 180/393] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:51 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:52.200164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:52.200789 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:52.207207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:52.207661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:52.208435 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:52.209458 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:52.336644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:52.344595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-86d40a6d-8edd-4a5b-8c33-6a4c14c33816 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.233587 Jun 20 06:06:52.345186 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 214/394] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:52 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:52.402554 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:52.410006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6487e8e4-af0d-4b13-9619-b1d9e4e44c41 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.213778 Jun 20 06:06:52.410503 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 181/395] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:52 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:52.933370 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-ce1a752b-4fba-47b1-98b9-6aa815930b2d req-c57b570b-a565-4307-a2d8-ffae04748f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d7331f-1d20-4a2e-b520-5a6d8a45d112", "name": "network-vif-plugged", "status": "completed", "tag": "5ebb7e6b-277b-4d1f-9454-0ec64cd2a770"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:52.942459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ce1a752b-4fba-47b1-98b9-6aa815930b2d req-c57b570b-a565-4307-a2d8-ffae04748f30 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:52.943795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ce1a752b-4fba-47b1-98b9-6aa815930b2d req-c57b570b-a565-4307-a2d8-ffae04748f30 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:52.960902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-ce1a752b-4fba-47b1-98b9-6aa815930b2d req-c57b570b-a565-4307-a2d8-ffae04748f30 service nova] Creating event network-vif-plugged:5ebb7e6b-277b-4d1f-9454-0ec64cd2a770 for instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 on hv-cinder-83699 Jun 20 06:06:52.966178 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-ce1a752b-4fba-47b1-98b9-6aa815930b2d req-c57b570b-a565-4307-a2d8-ffae04748f30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036768 Jun 20 06:06:52.966846 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 215/396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:53.201416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:53.203601 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:53.214184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:53.214993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:53.215870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:53.216327 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:53.364006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:53.364854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:53.374045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:53.375086 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:53.376656 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:53.377579 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:53.431701 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:53.440661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:53.442229 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:53.444047 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6ee8225b-2545-4d0b-9a9f-0ead5f7706a9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.247101 Jun 20 06:06:53.444610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 182/397] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:53 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:53.449573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:53.450021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:53.456712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:53.457516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:53.458540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:53.459232 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:53.604557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:53.612791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6541c3ae-198e-4c34-ad87-1c7fc0953a2c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.253525 Jun 20 06:06:53.613626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 216/398] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:53 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:53.632191 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:53.639890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-53ca61b4-5477-4e59-9e0b-87b605e70dc7 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.194242 Jun 20 06:06:53.640464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 183/399] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:53 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:54.464365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:54.465039 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:54.470392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:54.472379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:54.473570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:54.474876 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:54.475317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:54.611592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:54.620448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:54.622144 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:54.623572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-913d630d-6170-41d5-8add-3ceb849939d1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.163279 Jun 20 06:06:54.630119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:54.631383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:54.633344 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:54.634004 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:54.634658 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 217/400] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:54 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:54.640439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:54.640891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:54.641684 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:54.642121 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:54.658970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:54.659660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:54.666965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:54.667413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:54.668178 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:54.668605 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:54.871924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:54.875788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:54.885749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-44f99223-f3b9-4344-ac0f-fc74a5d2d61f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1370 microversion: 2.1 time: 0.231593 Jun 20 06:06:54.886998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 218/401] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:54 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:54.887434 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4f5ef015-bd16-4c8d-84f0-c1147ad1b8dd tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1725 microversion: 2.1 time: 0.261029 Jun 20 06:06:54.893343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 184/402] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:54 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:06:55.240543 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1949325131", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-178333891", "security_groups": [{"name": "tempest-secgroup-smoke-1782937955"}], "networks": [{"uuid": "998bb34c-d831-40d3-9139-763dab493992"}], "block_device_mapping_v2": [{"uuid": "bc711626-19c2-42ee-88bf-c907da047343", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:55.383849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] validate_networks() for [('998bb34c-d831-40d3-9139-763dab493992', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:06:55.642348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:55.643927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:55.650779 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:55.651721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:55.652918 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:55.655694 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:55.924170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:55.933764 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:55.935754 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:55.937212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ebc0bca1-5a48-47f1-8710-7ca621a4cfc0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.299185 Jun 20 06:06:55.938138 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 185/403] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:55 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:06:55.943690 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ca6a78d-0366-4300-a9b3-c00555465dd3", "device": "/dev/sdb"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:55.945893 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:55.953090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:55.953668 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:55.954528 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:55.955177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:55.965331 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:06:55.966457 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:06:55.967187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:06:55.968702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:06:55.969392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:06:55.980437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:55.981164 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:55.982174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:55.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.010331 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Getting quotas for project c2faf73842cb4faabb12f920b54bbcb7. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:06:56.018369 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Getting quotas for user a99817225e5d420880fe221b74c22518 and project c2faf73842cb4faabb12f920b54bbcb7. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:06:56.049935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:56.093686 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:06:56.096317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc711626-19c2-42ee-88bf-c907da047343',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:06:56.290493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d1640b6b-f214-4f28-a7d4-fd4a68524742 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.054705 Jun 20 06:06:56.291470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 219/404] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:06:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:06:56.297151 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:56.297968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:56.307476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.308349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.309386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.309991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.354425 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b667082a-6e72-432b-94d4-7660e0c45b9e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "POST /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414785 Jun 20 06:06:56.357531 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 186/405] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:06:55 2022] POST /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:56.366954 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:56.368164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:56.379071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.379947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.381294 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.382419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.550647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:56.559029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5f7420cf-633e-4cfe-9aa0-2a5b162d81ec tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1702 microversion: 2.1 time: 0.266320 Jun 20 06:06:56.565079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 220/406] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:56 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1702 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:56.570396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0d6e6d77-95c9-45ce-9338-21b6da8e098b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:56.579676 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0d6e6d77-95c9-45ce-9338-21b6da8e098b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:56.674691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0d6e6d77-95c9-45ce-9338-21b6da8e098b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:56.682039 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0d6e6d77-95c9-45ce-9338-21b6da8e098b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1088 microversion: 2.1 time: 0.115829 Jun 20 06:06:56.696560 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 221/407] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:56 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1088 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:56.704428 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-53c58ba0-4e28-4e78-80d1-a1d3770a02c2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:56.717788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-53c58ba0-4e28-4e78-80d1-a1d3770a02c2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.718245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-53c58ba0-4e28-4e78-80d1-a1d3770a02c2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.750450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:56.760397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2acbfc96-9927-4c51-a079-21dbcb0c6684 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1565 microversion: 2.1 time: 0.400277 Jun 20 06:06:56.772446 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 187/408] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:56 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1565 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:56.772951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-53c58ba0-4e28-4e78-80d1-a1d3770a02c2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Going to try to start instance {{(pid=117666) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 06:06:56.782840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:56.783789 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:56.792496 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.793311 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.794450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.795047 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.835941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-53c58ba0-4e28-4e78-80d1-a1d3770a02c2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action" status: 202 len: 0 microversion: 2.1 time: 0.137889 Jun 20 06:06:56.837176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 222/409] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:06:56 2022] POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:06:56.847216 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:56.848178 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:56.863651 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.874666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.876752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:56.877236 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:56.975829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cfafa09c-24cf-494c-a0dd-44902652a3c5 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201010 Jun 20 06:06:56.976433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 188/410] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:06:56 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:06:56.988280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:56.989259 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:57.011405 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:57.012251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:57.013728 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:57.014478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:57.254302 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:57.270922 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d2200267-c3d4-45d0-a961-a2e12e17969f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1711 microversion: 2.1 time: 0.424976 Jun 20 06:06:57.272775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 223/411] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:56 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1711 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:57.327978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:57.340270 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:57.345216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:57.350291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-40a14f74-f84c-48bb-b626-b0db85e9023d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.365873 Jun 20 06:06:57.351007 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 189/412] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:56 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:57.700449 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:57.700993 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:57.713804 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:57.714977 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:57.722083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:57.723348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:57.917475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:57.936787 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a5e39af0-097e-4f12-aff8-67b8c4f6906d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1186 microversion: 2.1 time: 0.241220 Jun 20 06:06:57.940615 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 224/413] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:57 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1186 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:58.335669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:58.342287 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:58.375233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:58.377971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:58.414762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:58.415649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:58.416669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:58.421330 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:58.457005 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:58.459049 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:58.486703 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:58.487193 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:58.780086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:58.788379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4f9a20cf-ea19-4c48-97ce-c6d9b7429bb6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1711 microversion: 2.1 time: 0.502642 Jun 20 06:06:58.788951 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 190/414] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:58 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1711 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:58.866900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:58.884568 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:58.890380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:58.893077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b40e88c2-50ef-43d6-8c9b-61c9984d5ff8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.526172 Jun 20 06:06:58.895690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 225/415] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:58 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:06:58.956807 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:58.957783 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:58.974689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:58.987846 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:58.989174 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:58.989632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:58.994402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-a862a162-a98f-4d8b-81c5-121a82354ca3 req-1cb0f425-295f-4280-bc4d-faa5ca490461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d7331f-1d20-4a2e-b520-5a6d8a45d112", "tag": "5ebb7e6b-277b-4d1f-9454-0ec64cd2a770"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:06:59.003078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-a862a162-a98f-4d8b-81c5-121a82354ca3 req-1cb0f425-295f-4280-bc4d-faa5ca490461 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:59.003880 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-a862a162-a98f-4d8b-81c5-121a82354ca3 req-1cb0f425-295f-4280-bc4d-faa5ca490461 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:59.028051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-a862a162-a98f-4d8b-81c5-121a82354ca3 req-1cb0f425-295f-4280-bc4d-faa5ca490461 service nova] Creating event network-changed:5ebb7e6b-277b-4d1f-9454-0ec64cd2a770 for instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 on hv-cinder-83699 Jun 20 06:06:59.035988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-a862a162-a98f-4d8b-81c5-121a82354ca3 req-1cb0f425-295f-4280-bc4d-faa5ca490461 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045196 Jun 20 06:06:59.037524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 226/416] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:06:59.149402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:06:59.169127 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-160bb328-1707-4d22-b231-415c2e0bb9e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1204 microversion: 2.1 time: 0.214613 Jun 20 06:06:59.171183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 191/417] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:58 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1204 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:06:59.808001 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:59.810019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:59.826383 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:59.827025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:59.827983 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:59.828575 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:59.920734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:06:59.922018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:06:59.930949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:59.931787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:06:59.932724 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:06:59.933640 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:00.618285 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:00.628656 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aa4ce651-f915-4548-9c00-25cb57eeda76 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1715 microversion: 2.1 time: 0.825454 Jun 20 06:07:00.630003 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 227/418] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:06:59 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1715 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:00.651895 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:00.652884 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:00.662616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:00.663342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:00.664374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:00.665202 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:00.699912 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:00.707786 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:00.711071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:00.712370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4e74fa24-a4fb-4c43-a373-03398c8a1a4a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.798112 Jun 20 06:07:00.713195 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 192/419] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:06:59 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:00.994319 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:00.998006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:01.010221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f7cc3891-71c9-499d-9b89-cd398ab6b6e3 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.375151 Jun 20 06:07:01.011227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 228/420] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:00 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:01.731298 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:01.731905 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:01.741269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:01.743043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:01.750370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:01.751226 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:01.792624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-cb61687a-0283-4db2-af53-ef2906247ec3 req-d149e02f-05d0-4db1-a7cc-2ef5a816849a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:01.807537 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-cb61687a-0283-4db2-af53-ef2906247ec3 req-d149e02f-05d0-4db1-a7cc-2ef5a816849a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:01.807989 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-cb61687a-0283-4db2-af53-ef2906247ec3 req-d149e02f-05d0-4db1-a7cc-2ef5a816849a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:01.845917 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-cb61687a-0283-4db2-af53-ef2906247ec3 req-d149e02f-05d0-4db1-a7cc-2ef5a816849a service nova] Creating event network-changed:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:07:01.852380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-cb61687a-0283-4db2-af53-ef2906247ec3 req-d149e02f-05d0-4db1-a7cc-2ef5a816849a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065573 Jun 20 06:07:01.854771 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 229/421] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:07:02.030101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:02.031084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:02.041690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:02.042868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:02.043779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:02.044327 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:02.137444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:02.152251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:02.154297 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:02.155760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-61270bbc-577b-4a7d-8ab2-4459863e2dab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.428572 Jun 20 06:07:02.156497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 193/422] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:01 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:02.258342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:02.266015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-942db46b-78a2-47fd-b66b-63f929b82713 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.241821 Jun 20 06:07:02.267116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 230/423] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:02 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:03.174684 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:03.175293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:03.181758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:03.182209 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:03.182967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:03.183408 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:03.283716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:03.284958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:03.294675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:03.295490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:03.296299 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:03.296781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:03.411525 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:03.419426 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:03.420938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:03.422125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-50f7747b-6cdc-405f-91b6-8340eab60533 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1739 microversion: 2.20 time: 0.251272 Jun 20 06:07:03.422686 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 194/424] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:03 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:03.485616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:03.493063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c0f93927-d905-42b5-9429-ffb921b65964 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.213830 Jun 20 06:07:03.493630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 231/425] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:03 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:04.439187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:04.439788 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:04.446796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:04.447241 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:04.447988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:04.448414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:04.510040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:04.510645 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:04.516342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:04.516783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:04.517563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:04.517991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:04.841937 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:04.850286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:04.851810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:04.853006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-92d103f7-f33c-4e14-ab3c-c7bbbd8c64e7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1721 microversion: 2.20 time: 0.417711 Jun 20 06:07:04.853550 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 195/426] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:04 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:04.869887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:04.877246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-45910767-011e-4ad2-8724-c54ce0c6f7eb tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.370962 Jun 20 06:07:04.877803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 232/427] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:04 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:05.871745 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:05.872375 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:05.879130 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:05.879581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:05.880843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:05.881310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:05.893370 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:05.894224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:05.900674 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:05.901158 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:05.902068 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:05.902546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:05.993972 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:06.078488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:06.086883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:06.088527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:06.089928 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7c64ed89-b0ad-4558-81cd-1e3f2f9583e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1721 microversion: 2.20 time: 0.222336 Jun 20 06:07:06.090564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 196/428] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:05 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:06.091414 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:06.099824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-63c9167f-a140-4a24-897c-dda961d22d5d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.210172 Jun 20 06:07:06.100385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 233/429] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:05 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:07.107875 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:07.108477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:07.115010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:07.115453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:07.116108 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:07.116506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:07.116601 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:07.116744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:07.118619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=8 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:07.124325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:07.124779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:07.125567 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:07.126006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:07.555183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:07.557596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:07.565482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-117394cb-f743-4a2c-a810-11292965268a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.453070 Jun 20 06:07:07.566011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:07.567653 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:07.569880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e482c7ff-b948-43c8-88bc-a9256ef592b4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1721 microversion: 2.20 time: 0.465777 Jun 20 06:07:07.579151 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 234/430] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:07 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:07.579251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 197/431] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:07 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1721 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:07.632083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-a4cbb2e4-67d0-47e5-a166-a441979064ff req-1396e7a0-0298-4724-b2ca-66517e5b169e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "name": "network-vif-unplugged", "status": "completed", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:07.640088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-a4cbb2e4-67d0-47e5-a166-a441979064ff req-1396e7a0-0298-4724-b2ca-66517e5b169e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:07.640759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-a4cbb2e4-67d0-47e5-a166-a441979064ff req-1396e7a0-0298-4724-b2ca-66517e5b169e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:07.652282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-a4cbb2e4-67d0-47e5-a166-a441979064ff req-1396e7a0-0298-4724-b2ca-66517e5b169e service nova] Creating event network-vif-unplugged:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:07:07.657056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-a4cbb2e4-67d0-47e5-a166-a441979064ff req-1396e7a0-0298-4724-b2ca-66517e5b169e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029172 Jun 20 06:07:07.657589 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 235/432] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:08.583155 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:08.583852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:08.590107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:08.590682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:08.590995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:08.591116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:08.591839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:08.592311 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:08.598127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:08.598583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:08.599892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:08.600333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:08.798792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:08.805163 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:08.808635 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e92af798-e2bf-4f44-b32a-c2032f86003e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1272 microversion: 2.1 time: 0.229286 Jun 20 06:07:08.809348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 198/433] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:08 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:08.814478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:08.816010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:08.817217 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d95eda7c-03e6-4d2f-a7f1-15f8bfe0cf9f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1721 microversion: 2.20 time: 0.231880 Jun 20 06:07:08.818266 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 236/434] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:08 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:09.825938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:09.826542 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:09.833865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:09.834304 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:09.835062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:09.835489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:09.840719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:09.841367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:09.847546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:09.848116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:09.849555 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:09.850160 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.037791 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.040818 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.045405 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b6732112-d1d7-4e10-94af-ce10f416124e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.223397 Jun 20 06:07:10.045980 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 199/435] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:09 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:10.048962 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.050488 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.051666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6142c8bb-056c-4aee-ac50-82438f39cbe1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1664 microversion: 2.20 time: 0.218333 Jun 20 06:07:10.052395 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 237/436] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:09 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1664 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:10.069515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d58a3907-f9aa-488e-ae53-e2ad79194f41"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:10.070650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:10.076580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:10.077066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.077826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:10.078261 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.263381 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:10.348872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-05cc244b-ef66-4713-b1d8-ce74386732c5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283745 Jun 20 06:07:10.349596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 200/437] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jun 20 06:07:10 2022] POST /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:07:10.461163 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:10.461732 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:10.467596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:10.468077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.468833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:10.469291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.564562 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cfd97e85-818c-4065-b963-1071f16ee719 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/action" status: 202 len: 0 microversion: 2.20 time: 0.107806 Jun 20 06:07:10.565107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 238/438] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 20 06:07:10 2022] POST /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:07:10.573848 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:10.574465 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:10.583357 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:10.583814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.584592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:10.585059 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:10.720930 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.729253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.730734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:10.731943 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6ce32e33-e0fc-4c9b-baf4-b38409ca4b78 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1750 microversion: 2.20 time: 0.161976 Jun 20 06:07:10.732502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 201/439] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:10 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:11.062213 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:11.062912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:11.069505 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:11.069505 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:11.070274 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:11.070712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:11.208593 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:11.216712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4299c840-867d-4ae6-bafd-c63962de63ef tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.158298 Jun 20 06:07:11.217192 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 239/440] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:11 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:11.750999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:11.751718 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:11.754001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.759468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:11.759924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:11.760688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:11.761166 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:11.887330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:11.895812 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:11.897358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:11.898530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5337b7ff-e09f-450e-a015-3928b8e014bd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1750 microversion: 2.20 time: 0.151429 Jun 20 06:07:11.899254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 202/441] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:11 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:12.233793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:12.234351 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:12.240273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:12.240722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:12.241512 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:12.241942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:12.372584 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:12.380481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0d74ac11-2832-459a-9ab0-f91d966ed758 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.150068 Jun 20 06:07:12.381089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 240/442] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:12 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:12.931635 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:12.932243 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:12.938625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:12.939080 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:12.939837 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:12.940272 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:13.076480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:13.084835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:13.086432 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:13.087576 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1e080cf2-b04c-4eca-86c9-a034127f01f3 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1752 microversion: 2.20 time: 0.159760 Jun 20 06:07:13.088126 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 203/443] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:12 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:13.397811 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:13.398337 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:13.404137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:13.404597 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:13.405442 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:13.405874 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:13.537410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:13.544626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7911d885-e565-4480-804a-3d102fc7d522 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.151008 Jun 20 06:07:13.545212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 241/444] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:13 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:14.106318 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:14.107659 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:14.117568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:14.118429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:14.119361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:14.119823 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:14.246692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:14.255134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:14.256651 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:14.257848 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1af6d27f-aa43-4576-9511-0bbbe58d624e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.155728 Jun 20 06:07:14.258413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 204/445] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:14 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:14.561826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:14.562457 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:14.568816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:14.569291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:14.570055 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:14.570467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:14.694781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:14.702057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a655b91b-9efb-4a01-8bd3-83557ca76697 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.144101 Jun 20 06:07:14.702608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 242/446] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:14 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:15.274927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:15.275540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:15.282285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:15.282795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:15.283567 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:15.284010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:15.412456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:15.421008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:15.422516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:15.423683 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8244265b-c280-4194-8a8d-2251fd002487 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.152619 Jun 20 06:07:15.424241 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 205/447] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:15 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:07:15.718524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:15.719070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:15.725617 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:15.726071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:15.726830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:15.727270 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:15.851995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:15.859332 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dcba2bce-2af9-43b0-a353-6e925b8cc6af tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.144684 Jun 20 06:07:15.859897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 243/448] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:15 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:16.443082 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:16.443735 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:16.450173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:16.450622 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:16.451377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:16.451810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:16.581694 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:16.589896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:16.591398 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:16.592564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-47ea879f-4ad3-4977-989d-cf04acb0018b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.153990 Jun 20 06:07:16.593127 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 206/449] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:16 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:16.875766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:16.876385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:16.883152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:16.883610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:16.884389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:16.884824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:17.017761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:17.026039 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-61422305-3fa2-4477-96b1-a3eb16c1c99a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.154138 Jun 20 06:07:17.026595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 244/450] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:16 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:17.610470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:17.611069 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:17.617541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:17.617984 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:17.618733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:17.619162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:17.746025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:17.754174 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:17.756146 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:17.757319 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f9188d82-17bb-47c0-a36a-95b9e4bf4945 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.150682 Jun 20 06:07:17.757871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 207/451] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:17 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:18.042389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:18.042991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:18.053329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:18.053329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:18.053329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:18.053329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:18.268476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:18.271553 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:18.277897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8bc0f556-6070-4b93-aec4-47ba152765d1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.239325 Jun 20 06:07:18.278471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 245/452] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:18 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:18.777012 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:18.777626 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:18.783861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:18.784481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:18.785238 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:18.785673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:18.929536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:18.942345 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:18.945117 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:18.946776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-608051c0-7f9e-49b4-a60b-8187c276dbac tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.175188 Jun 20 06:07:18.947717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 208/453] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:18 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:19.296360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:19.297038 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:19.307996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:19.308454 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:19.309983 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:19.310425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:19.501631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:19.515187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-128f87de-4ff6-4c76-abe1-44497d5c4745 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.219762 Jun 20 06:07:19.516386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 246/454] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:19 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:19.971038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:19.972672 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:19.983335 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:19.984076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:19.985040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:19.985746 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:20.178564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:20.188154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:20.190192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:20.191698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a5a809de-bb20-4eb5-aee2-463e0da0559a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.228750 Jun 20 06:07:20.192816 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 209/455] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:19 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:20.533810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:20.535084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:20.542437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:20.543144 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:20.544117 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:20.544766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:20.688088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:20.703805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-761e0d49-cc72-4c9a-8807-103e4b1033db tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.173654 Jun 20 06:07:20.704307 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 247/456] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:20 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:21.050821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-d98a06e9-ca4d-4e2f-b7f5-954cfaa3a0ca req-135c1f8a-59ee-4a4e-bba3-14d261ec0720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "name": "network-vif-plugged", "status": "completed", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:21.070087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d98a06e9-ca4d-4e2f-b7f5-954cfaa3a0ca req-135c1f8a-59ee-4a4e-bba3-14d261ec0720 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.070543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d98a06e9-ca4d-4e2f-b7f5-954cfaa3a0ca req-135c1f8a-59ee-4a4e-bba3-14d261ec0720 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.082195 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-d98a06e9-ca4d-4e2f-b7f5-954cfaa3a0ca req-135c1f8a-59ee-4a4e-bba3-14d261ec0720 service nova] Creating event network-vif-plugged:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:07:21.087674 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-d98a06e9-ca4d-4e2f-b7f5-954cfaa3a0ca req-135c1f8a-59ee-4a4e-bba3-14d261ec0720 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040711 Jun 20 06:07:21.088573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 210/457] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:21.210659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:21.211343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:21.217633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.218088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.218859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.219293 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.360236 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:21.369636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:21.371195 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:21.372372 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a31f8216-72d5-424b-addf-b0156304a545 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.165790 Jun 20 06:07:21.373004 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 248/458] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:21 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:21.516432 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:21.517119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:21.524007 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.524536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.525648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.526159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.652474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lazy-loading 'services' on Instance uuid d3d584cd-f025-4437-9cf6-f3eab8a6a641 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:07:21.721472 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:21.722903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:21.734231 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.734883 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.735830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:21.736269 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:21.807769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7aaed84c-8222-4897-86ca-c6ec95bacc3f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641/os-volume_attachments/8ca6a78d-0366-4300-a9b3-c00555465dd3" status: 202 len: 0 microversion: 2.1 time: 0.295934 Jun 20 06:07:21.808446 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 211/459] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:07:21 2022] DELETE /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641/os-volume_attachments/8ca6a78d-0366-4300-a9b3-c00555465dd3 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:07:21.923506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:21.931614 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8925754c-6078-4f79-8045-47bfc9efcf88 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.214188 Jun 20 06:07:21.932705 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 249/460] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:21 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:22.393349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:22.393349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:22.399638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:22.400089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:22.400856 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:22.401317 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:22.551751 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:22.560360 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:22.561895 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:22.563084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-46de86da-8cf3-4ed2-a5e5-0b9329f92496 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.176242 Jun 20 06:07:22.563656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 212/461] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:22 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:22.949434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:22.950047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:22.952115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:22.959263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:22.959719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:22.960497 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:22.960940 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:23.101628 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:23.109062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ab9329ba-24f6-4dc7-9077-b1a04ef74454 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.163556 Jun 20 06:07:23.112264 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 250/462] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:22 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:23.581604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:23.582250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:23.589869 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:23.590316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:23.591084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:23.591513 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:23.730480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:23.739412 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:23.741145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:23.742568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-df10024c-b5d9-4195-bec2-da7630d0a920 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.164916 Jun 20 06:07:23.743379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 213/463] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:23 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:24.126206 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:24.126884 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:24.133598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:24.134057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:24.134821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:24.135263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:24.272779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:24.280827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e8fef42d-2b74-4f02-9d1d-6848c67177aa tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.158400 Jun 20 06:07:24.281450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 251/464] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:24 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:24.760442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:24.761343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:24.768145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:24.768707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:24.769855 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:24.770366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:24.903872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:24.912707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:24.914291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:24.915445 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fb7cca47-31bd-4454-831e-6125f1855704 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.159434 Jun 20 06:07:24.916000 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 214/465] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:24 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:25.298568 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:25.299159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:25.305413 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:25.305890 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:25.306644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:25.307101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:25.443726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:25.451204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-36f1a128-cb2f-47a5-a3db-e0cb0cf10bad tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.156596 Jun 20 06:07:25.451764 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 252/466] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:25 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:25.938425 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:25.939360 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:25.950945 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:25.952116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:25.953204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:25.953861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:26.140349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:26.149728 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:26.151309 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:26.152479 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-23a545c7-0a66-4ea8-ae7d-486560ab64b5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.221323 Jun 20 06:07:26.153064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 215/467] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:25 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:26.467623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:26.468239 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:26.475560 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:26.476015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:26.476788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:26.477255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:26.621278 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:26.628816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1d7de01f-5155-4d2f-88ef-ee28fe9811da tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.165085 Jun 20 06:07:26.629908 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 253/468] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:26 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:27.172364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:27.173247 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:27.189087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:27.189633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:27.190489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:27.190997 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:27.210324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:27.326212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:27.335386 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:27.336894 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:27.338087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-09e4e323-1f55-410d-bc07-992a742ade8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.170730 Jun 20 06:07:27.338850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 216/469] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:27 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:27.646247 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:27.646832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:27.654044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:27.654659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:27.655764 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:27.656923 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:27.793607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:27.801277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-79788693-3ed2-404f-b8aa-f54f507b9b4f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.159138 Jun 20 06:07:27.801997 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 254/470] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:27 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:28.356681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:28.357285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:28.364297 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:28.364743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:28.365570 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:28.366019 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:28.500816 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:28.509896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:28.511385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:28.512696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-05f35cd5-c90c-4454-a474-7da2aa4aa19f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.159916 Jun 20 06:07:28.513301 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 217/471] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:28 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:28.818197 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:28.818837 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:28.825292 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:28.825740 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:28.826528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:28.826957 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:28.955211 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:28.962570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-85863283-6435-46fb-82ad-13c716e8dc1f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.148228 Jun 20 06:07:28.963135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 255/472] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:28 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:29.530887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:29.531424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:29.538337 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:29.538790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:29.539550 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:29.539987 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:29.667648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:29.675886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:29.677717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:29.678876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d4692f5d-1ce7-4783-b6fd-eb0361971c7d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.151932 Jun 20 06:07:29.679444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 218/473] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:29 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:29.979235 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:29.979853 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:29.985833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:29.986317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:29.987081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:29.987516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:30.120873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:30.128147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5963c61c-6f37-4826-8ceb-d8e742b4c033 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.152789 Jun 20 06:07:30.128707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 256/474] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:29 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:30.697067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:30.697674 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:30.704106 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:30.704556 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:30.705348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:30.705787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:30.830338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:30.839129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:30.840648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:30.841850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d4aa8089-4148-45c4-8ddf-5df950646461 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.148715 Jun 20 06:07:30.842416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 219/475] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:30 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:31.145059 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:31.145752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:31.152364 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.152821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.153614 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.154065 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.282519 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:31.290363 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b90da104-9974-435a-9f85-b831ad9a2a01 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.149502 Jun 20 06:07:31.290920 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 257/476] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:31 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:31.402337 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:31.402775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:31.408677 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.409169 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.409933 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.410403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.434646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:07:31.508126 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bf23532d-60ef-4f63-8b90-07aef1f4dd79 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 204 len: 0 microversion: 2.1 time: 0.109461 Jun 20 06:07:31.508695 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 220/477] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:07:31 2022] DELETE /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:07:31.517542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:31.518311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:31.524735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.525223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.526017 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.526450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.661179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:31.668521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7b7461ec-c3bb-43a9-b131-15a6157f6ee7 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1512 microversion: 2.1 time: 0.155656 Jun 20 06:07:31.669100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 258/478] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:31 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:31.860814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:31.861540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:31.868575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.869055 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.869813 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:31.870249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:31.995636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:32.004001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:32.005546 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:32.006696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-36595c99-5839-4834-abcc-d11e1cd3b261 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.150158 Jun 20 06:07:32.007255 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 221/479] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:31 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:32.307700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:32.308415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:32.315090 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:32.315536 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:32.316289 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:32.316742 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:32.457738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:32.465125 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a95d6207-9e47-475d-9886-cc7dc04d5b2b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.161428 Jun 20 06:07:32.465780 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 259/480] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:32 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:32.695273 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:32.695802 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:32.701981 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:32.702430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:32.703186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:32.703624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:32.829193 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:32.837074 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9aca07a6-7ba3-4445-99b0-ffa41637566c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1512 microversion: 2.1 time: 0.154691 Jun 20 06:07:32.837639 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 222/481] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:32 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:33.025828 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:33.026432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:33.032267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:33.032711 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:33.033492 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:33.033924 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:33.162586 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:33.170854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:33.172338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:33.173513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b2a0d08d-6481-42e0-9194-70f925a573ae tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.152000 Jun 20 06:07:33.174061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 260/482] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:33 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:07:33.482515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:33.483051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:33.490164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:33.490662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:33.491424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:33.491850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:33.622201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:33.629610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f096a4ef-166a-4df9-bf48-5817db04dc86 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1260 microversion: 2.1 time: 0.150984 Jun 20 06:07:33.630177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 223/483] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:33 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:33.854631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:33.855232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:33.861224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:33.861670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:33.862418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:33.862844 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:33.985908 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:33.993316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-46b58697-c598-4050-a268-31ad7097ddf0 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1512 microversion: 2.1 time: 0.142452 Jun 20 06:07:33.993874 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 261/484] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:33 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:34.192322 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:34.192879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:34.198885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:34.199333 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:34.200080 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:34.200511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:34.332890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:34.341156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:34.342654 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:34.343796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-221ab584-fb1c-468d-a187-f493da5cdc60 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.156108 Jun 20 06:07:34.344350 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 224/485] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:34 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:34.646384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:34.647088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:34.654397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:34.654851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:34.655619 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:34.656053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:34.670642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:34.847317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:34.855428 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-83d23634-cc70-490d-9b93-1afd6408a86b tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1444 microversion: 2.1 time: 0.213081 Jun 20 06:07:34.856165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 262/486] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:34 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1444 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:34.874633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:34.875335 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:34.881580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:34.882025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:34.882792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:34.883227 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:35.012314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:35.012920 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:35.019158 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:35.019603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:35.020439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:35.020865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:35.111132 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:35.119261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4cdd0126-80d5-47b3-87b0-4848464e70cb tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1470 microversion: 2.1 time: 0.112190 Jun 20 06:07:35.119833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 263/487] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:35 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1470 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:35.124138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-682ec3b6-485e-460d-bad2-4f5b75880760 req-d47a3a11-e675-4d41-a65a-ddb128bbb855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d584cd-f025-4437-9cf6-f3eab8a6a641", "name": "network-vif-deleted", "tag": "069375a9-c8c2-45c9-a048-4950477315c7"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:35.127946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:35.135438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5c3b10aa-f4d6-4aaf-b2aa-c55021cb1765 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1444 microversion: 2.1 time: 0.264593 Jun 20 06:07:35.136181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 225/488] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:34 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1444 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:35.136707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-682ec3b6-485e-460d-bad2-4f5b75880760 req-d47a3a11-e675-4d41-a65a-ddb128bbb855 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:35.137289 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-682ec3b6-485e-460d-bad2-4f5b75880760 req-d47a3a11-e675-4d41-a65a-ddb128bbb855 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:35.150190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-682ec3b6-485e-460d-bad2-4f5b75880760 req-d47a3a11-e675-4d41-a65a-ddb128bbb855 service nova] Creating event network-vif-deleted:069375a9-c8c2-45c9-a048-4950477315c7 for instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 on hv-cinder-83699 Jun 20 06:07:35.155302 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-682ec3b6-485e-460d-bad2-4f5b75880760 req-d47a3a11-e675-4d41-a65a-ddb128bbb855 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Jun 20 06:07:35.156070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 264/489] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:35.362546 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:35.363079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:35.369795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:35.370252 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:35.371027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:35.371460 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:35.503340 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:35.511619 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:35.513142 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:35.514291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4eb62ae4-eaf8-4cad-bae8-2079adbee2b6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.156240 Jun 20 06:07:35.515054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 226/490] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:35 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:36.136462 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:36.137303 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:36.143460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:36.144156 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:36.145444 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:36.145875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:36.175991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:36.176431 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:36.176889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lazy-loading 'fault' on Instance uuid d3d584cd-f025-4437-9cf6-f3eab8a6a641 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:07:36.222235 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:36.230081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-de0e3b50-1128-451c-87d1-08ecbe969a94 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 200 len: 1309 microversion: 2.1 time: 0.098135 Jun 20 06:07:36.230709 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 265/491] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:36 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:36.533109 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:36.533708 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:36.540612 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:36.541096 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:36.541861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:36.542399 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:36.688874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:36.698279 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:36.700134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:36.701655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-958a9b71-9e1a-4f84-a08a-1291f2fe8671 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.172405 Jun 20 06:07:36.707285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 227/492] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:36 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:36.863486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-d743361e-a7cb-4778-954f-a2fa50cc4ef9 req-499ee508-6376-451b-9d4f-7778c24aa3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:36.872275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-d743361e-a7cb-4778-954f-a2fa50cc4ef9 req-499ee508-6376-451b-9d4f-7778c24aa3ca service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:36.872731 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-d743361e-a7cb-4778-954f-a2fa50cc4ef9 req-499ee508-6376-451b-9d4f-7778c24aa3ca service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:36.883404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-d743361e-a7cb-4778-954f-a2fa50cc4ef9 req-499ee508-6376-451b-9d4f-7778c24aa3ca service nova] Creating event network-changed:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:07:36.888203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-d743361e-a7cb-4778-954f-a2fa50cc4ef9 req-499ee508-6376-451b-9d4f-7778c24aa3ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028591 Jun 20 06:07:36.888858 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 266/493] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:37.247573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:37.248189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: d3d584cd-f025-4437-9cf6-f3eab8a6a641] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:37.255572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:37.256032 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:37.256806 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:37.257279 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:37.272743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] HTTP exception thrown: Instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 could not be found. Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Request method failure captured: Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 HTTP/1.1 Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA5RN8k7w5azfwEWCzPBOT_Gj8sVFD0iTQuwspioLualBSr6L1tsSxdF6eH8C41n8l6M49Y9RS_6Uc9HTM9M17Hf6e-AX360gTYBsWxbB7jkopHj4A7IPj5q4z9AdiWKw7XQltUQwHTR-wLzDTXoMggGbMaLV7_eMhN3Y1p1tqttE0g Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 6ef63de6229c418f8fa2dd4c988e5855 Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesSnapshotTestJSON-533013377 Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:07:37.274454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ef63de6229c418f8fa2dd4c988e5855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ef63de6229c418f8fa2dd4c988e5855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ef63de6229c418f8fa2dd4c988e5855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ef63de6229c418f8fa2dd4c988e5855", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesSnapshotTestJSON-533013377 Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 6ef63de6229c418f8fa2dd4c988e5855 Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-533013377 Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesSnapshotTestJSON-533013377-project Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 576d70d0517045fca9fbff6eaa846183 Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesSnapshotTestJSON-533013377-project Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 could not be found. Jun 20 06:07:37.276063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'd3d584cd-f025-4437-9cf6-f3eab8a6a641'} Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 could not be found. Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:07:37.277089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 could not be found. Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 could not be found. Jun 20 06:07:37.278281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:07:37.287814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Returning 404 to user: Instance d3d584cd-f025-4437-9cf6-f3eab8a6a641 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:07:37.287814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2045eac6-6211-43a4-927a-c42f12d9112e tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641" status: 404 len: 111 microversion: 2.1 time: 0.032199 Jun 20 06:07:37.287814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 228/494] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:37 2022] GET /compute/v2.1/servers/d3d584cd-f025-4437-9cf6-f3eab8a6a641 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:07:37.720541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:37.721200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:37.727658 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:37.728105 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:37.728866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:37.729329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:37.864694 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:37.873052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:37.874546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:37.875716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-914b6dda-5512-402d-9d27-57a6693a7009 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.159713 Jun 20 06:07:37.876267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 267/495] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:37 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:38.895157 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:38.895763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:38.902175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:38.902621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:38.903365 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:38.903796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:39.036045 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:39.044285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:39.045808 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:39.046955 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c14c43b2-12fc-4810-bc53-2fcd0979ccab tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.156511 Jun 20 06:07:39.047709 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 229/496] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:38 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:40.065370 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:40.065988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:40.072124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:40.072579 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:40.073369 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:40.073807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:40.201408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:40.210120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:40.211617 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:40.212766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4bbe50ee-59c2-4122-a310-932e9fc8d452 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.151387 Jun 20 06:07:40.213404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 268/497] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:40 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:07:41.183353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-89acad8a-b341-4bb6-a4a9-c39dfb61cf80 req-fbd7276e-96a3-4ee7-8a47-5cf2017f6233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "name": "network-vif-plugged", "status": "completed", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:41.191950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-89acad8a-b341-4bb6-a4a9-c39dfb61cf80 req-fbd7276e-96a3-4ee7-8a47-5cf2017f6233 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:41.192604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-89acad8a-b341-4bb6-a4a9-c39dfb61cf80 req-fbd7276e-96a3-4ee7-8a47-5cf2017f6233 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:41.205168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-89acad8a-b341-4bb6-a4a9-c39dfb61cf80 req-fbd7276e-96a3-4ee7-8a47-5cf2017f6233 service nova] Creating event network-vif-plugged:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:07:41.210582 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-89acad8a-b341-4bb6-a4a9-c39dfb61cf80 req-fbd7276e-96a3-4ee7-8a47-5cf2017f6233 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030895 Jun 20 06:07:41.211164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 230/498] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:41.231245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:41.231868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:41.237761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:41.238252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:41.239005 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:41.239437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:41.367228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:41.376067 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:41.377625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:41.379355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-19ff2a0a-0feb-4091-98eb-3c82ab7bdaf1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.151455 Jun 20 06:07:41.379920 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 269/499] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:41 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:07:42.399040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:42.399695 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:42.402163 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:42.407821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:42.408271 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:42.409061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:42.409508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:42.537616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:42.545849 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:42.547361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:42.548551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fa1e1f5c-7ca7-4373-a3d6-1c397d6f75e4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.154575 Jun 20 06:07:42.549153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 231/500] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:42 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:43.567716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:43.568318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:43.574328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:43.574773 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:43.575518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:43.575946 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:43.699234 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:43.709223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:43.710734 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:43.711884 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-db568009-6c09-4604-956b-d46d0cb870a2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.148527 Jun 20 06:07:43.712470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 270/501] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:43 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:44.730153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:44.730664 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:44.737220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:44.737665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:44.738410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:44.738844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:45.104454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:45.107843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:45.113785 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:45.115581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:45.116758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-22692267-f66d-4a83-a8aa-7af7392b20a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.390593 Jun 20 06:07:45.117338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 232/502] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:44 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:07:45.119106 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2034552718", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "networks": [{"uuid": "64bdea2b-1141-4954-8ef3-c8d6f86f89d0"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:45.169097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] validate_networks() for [('64bdea2b-1141-4954-8ef3-c8d6f86f89d0', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:07:45.504430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:07:45.504863 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:07:45.505347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:07:45.505749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:07:45.506194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:07:45.514716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:45.515157 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:45.515941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:45.516367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:45.533929 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Getting quotas for project 6ef63de6229c418f8fa2dd4c988e5855. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:07:45.537783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Getting quotas for user 576d70d0517045fca9fbff6eaa846183 and project 6ef63de6229c418f8fa2dd4c988e5855. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:07:45.548233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:07:45.550468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:07:45.595825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1584f5c4-34f4-4096-b354-6eb218246200 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480628 Jun 20 06:07:45.596647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 271/503] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:07:45.606381 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7a54cff3-5ec2-4d42-97e7-f6b5ede4c8fd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:45.607107 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7a54cff3-5ec2-4d42-97e7-f6b5ede4c8fd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:45.661814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7a54cff3-5ec2-4d42-97e7-f6b5ede4c8fd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:45.668512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7a54cff3-5ec2-4d42-97e7-f6b5ede4c8fd tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1219 microversion: 2.1 time: 0.065933 Jun 20 06:07:45.669108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 233/504] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:45 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:46.135147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:46.135761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:46.142361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:46.142819 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:46.143611 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:46.144788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:46.280727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:46.290563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:46.292101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:46.293316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-96cfe316-3ed3-4a26-94aa-3eabe90e555f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1808 microversion: 2.20 time: 0.162078 Jun 20 06:07:46.294042 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 272/505] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:46 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:46.686698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:46.687403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:46.693445 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:46.693886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:46.694640 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:46.695086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:46.756648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:46.764192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-79e9bbd6-33b8-4997-a560-debf292547fa tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1271 microversion: 2.1 time: 0.082150 Jun 20 06:07:46.764767 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 234/506] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:46 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:47.312699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:47.313356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:47.335281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:47.335733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:47.336509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:47.336939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:47.639658 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:47.648844 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:47.650716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:47.651868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f9d449db-1c6b-47e1-a10d-d2a2bd8c7d5a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1795 microversion: 2.20 time: 0.344211 Jun 20 06:07:47.652424 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 273/507] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:07:47 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1795 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:07:47.780606 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:47.781291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:47.788515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:47.788959 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:47.789749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:47.790194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:47.893551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:47.901685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3d7d7d52-c2a1-49c0-b986-32cf5ed7daf1 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1277 microversion: 2.1 time: 0.124966 Jun 20 06:07:47.902252 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 235/508] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:47 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:48.815838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-990d6c78-f693-419b-917d-04d04f984ccd req-72150686-66d0-44f9-8953-7760bc554f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2264fe9e-b7a3-4884-a67d-33ad6956cb0c", "tag": "e3be73da-f128-4188-a893-4697bbe0efae"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:48.823970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-990d6c78-f693-419b-917d-04d04f984ccd req-72150686-66d0-44f9-8953-7760bc554f38 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:48.824518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-990d6c78-f693-419b-917d-04d04f984ccd req-72150686-66d0-44f9-8953-7760bc554f38 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:48.837724 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-990d6c78-f693-419b-917d-04d04f984ccd req-72150686-66d0-44f9-8953-7760bc554f38 service nova] Creating event network-changed:e3be73da-f128-4188-a893-4697bbe0efae for instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c on hv-cinder-83699 Jun 20 06:07:48.843451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-990d6c78-f693-419b-917d-04d04f984ccd req-72150686-66d0-44f9-8953-7760bc554f38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031349 Jun 20 06:07:48.844050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 274/509] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:48.919348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:48.919889 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:48.927334 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:48.927775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:48.928522 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:48.928953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:49.054370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:49.061770 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-efaaf77d-3cae-4f03-b36f-8aaec552bf2a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1319 microversion: 2.1 time: 0.146395 Jun 20 06:07:49.062330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 236/510] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:48 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:50.078928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:50.079636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:50.086499 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:50.086944 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:50.087865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:50.088489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:50.218695 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:50.226659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-28668200-53ce-4eca-8854-e9fdab39acac tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1319 microversion: 2.1 time: 0.151929 Jun 20 06:07:50.227213 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 275/511] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:50 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:51.244014 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:51.245256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:51.251619 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:51.252067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:51.253048 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:51.253488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:51.388765 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:51.396816 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-673e9c2f-3659-4cd0-98fd-431290df5a7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1319 microversion: 2.1 time: 0.156896 Jun 20 06:07:51.397410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 237/512] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:51 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:52.413900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:52.414475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:52.420315 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:52.420758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:52.421548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:52.421975 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:52.545535 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:52.553355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-369958cf-e905-4644-97d8-afef3f28ee63 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1319 microversion: 2.1 time: 0.143409 Jun 20 06:07:52.553914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 276/513] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:52 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:53.270652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-89871334-7b17-432c-85bb-c0e8605917d2 req-82e07769-6c7f-4c83-aed4-ab03d0cd1c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2264fe9e-b7a3-4884-a67d-33ad6956cb0c", "name": "network-vif-plugged", "status": "completed", "tag": "e3be73da-f128-4188-a893-4697bbe0efae"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:53.279869 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-89871334-7b17-432c-85bb-c0e8605917d2 req-82e07769-6c7f-4c83-aed4-ab03d0cd1c2c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:53.280353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-89871334-7b17-432c-85bb-c0e8605917d2 req-82e07769-6c7f-4c83-aed4-ab03d0cd1c2c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:53.291596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-89871334-7b17-432c-85bb-c0e8605917d2 req-82e07769-6c7f-4c83-aed4-ab03d0cd1c2c service nova] Creating event network-vif-plugged:e3be73da-f128-4188-a893-4697bbe0efae for instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c on hv-cinder-83699 Jun 20 06:07:53.296477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-89871334-7b17-432c-85bb-c0e8605917d2 req-82e07769-6c7f-4c83-aed4-ab03d0cd1c2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 Jun 20 06:07:53.297173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 238/514] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:53.570645 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:53.571291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:53.573305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:53.579399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:53.579796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:53.580565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:53.581023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:53.709009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:53.716319 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ac2ba9f0-6629-43a9-acbc-a6c1c52d4b9d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1319 microversion: 2.1 time: 0.150139 Jun 20 06:07:53.716881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 277/515] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:53 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:54.687844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b132f3-69d1-4839-ad54-2616c21b85c3"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:54.689006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:54.695876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:54.696330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:54.697119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:54.697568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:54.733141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:54.733755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:54.739798 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:54.740248 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:54.741033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:54.741471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:54.873368 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:54.881429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-328ac202-90e5-4653-bdb1-ce7e0313ad7a tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1319 microversion: 2.1 time: 0.152273 Jun 20 06:07:54.881998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 278/516] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:54 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:07:55.661778 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-716b6a8c-e46b-4908-84f9-ec332b93ec1b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978554 Jun 20 06:07:55.662424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 239/517] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:07:54 2022] POST /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:55.899221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:55.899841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:55.901697 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:55.902438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:55.908072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:55.908522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:55.909308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:55.910400 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:56.036917 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:07:56.044348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c95c2921-7db5-4237-afc3-05c0ee3b6274 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1507 microversion: 2.1 time: 0.149067 Jun 20 06:07:56.044916 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 279/518] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:07:55 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:07:56.061265 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402e09ac-3da8-4066-b45b-9191a5416b5f", "device": "/dev/sdb"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:07:56.062512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:56.064490 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:56.070686 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:56.071148 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:56.071915 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:56.072353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:56.321636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-08ee8b28-1c9c-4751-ac60-87a57a8e8e48 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "POST /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264267 Jun 20 06:07:56.322255 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 240/519] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:07:56 2022] POST /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:07:56.971304 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:07:56.971820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:07:56.978304 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:56.978761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:56.979528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:07:56.979970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:07:57.101125 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lazy-loading 'services' on Instance uuid aaa707d4-de8c-4e79-8ea0-053c93eb13cd {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:07:57.203398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:57.215525 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-10a2f49b-7cea-4046-be9f-bbadb9220916 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-volume_attachments/b34b46a5-3010-47fc-9ff0-436142bcf7cf" status: 202 len: 0 microversion: 2.1 time: 0.248122 Jun 20 06:07:57.216125 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 280/520] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:07:56 2022] DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-volume_attachments/b34b46a5-3010-47fc-9ff0-436142bcf7cf => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:08:03.145873 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:03.146894 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:03.153765 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:03.154209 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:03.154959 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:03.155388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:03.178592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lazy-loading 'flavor' on Instance uuid 74d7331f-1d20-4a2e-b520-5a6d8a45d112 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:08:03.298101 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-edcdaa93-b0f2-42e1-a6d5-187a61df4e43 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/action" status: 200 len: 32 microversion: 2.1 time: 0.156660 Jun 20 06:08:03.298813 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 241/521] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:08:03 2022] POST /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:08:03.308717 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:03.309450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:03.316074 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:03.316556 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:03.317605 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:03.318282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:03.503450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:03.511377 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c547f81d-fd48-4e15-b8c3-f7b2117b5e77 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.206924 Jun 20 06:08:03.511945 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 281/522] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:03 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:04.530439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:04.531141 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:04.537801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:04.538250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:04.539008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:04.539441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:04.670748 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:04.679443 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-310cb765-ec59-4923-b5b2-eb95ed34dacb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.153720 Jun 20 06:08:04.680010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 242/523] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:04 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:05.697739 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:05.698437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:05.704486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:05.704940 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:05.705745 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:05.706184 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:05.830866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:05.838720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8398c4c9-c2e9-473c-b22f-db14a2b2ed63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.144738 Jun 20 06:08:05.839272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 282/524] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:05 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:06.855338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:06.855940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:06.863079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:06.863529 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:06.864283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:06.864716 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:06.993861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:07.001648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-166a9d2b-94f8-40df-ba7c-bb57ecf47d54 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.150070 Jun 20 06:08:07.002216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 243/525] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:06 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:08.019362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:08.020486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:08.026607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:08.027064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:08.027830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:08.028272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:08.153784 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:08.162284 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dba862b0-fc79-4223-920c-ba8f379a8627 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.146938 Jun 20 06:08:08.162852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 283/526] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:08 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:09.179909 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:09.180521 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:09.187050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:09.187502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:09.188267 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:09.188705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:09.314233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:09.322039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-576fedf4-45bf-4245-b40c-8a7771bda40f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.146602 Jun 20 06:08:09.322607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 244/527] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:09 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:10.339017 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:10.339750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:10.345722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:10.346176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:10.346938 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:10.347372 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:10.480231 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:10.488157 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9f5f0f75-7529-4b61-9052-64cd7c665ea4 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.152986 Jun 20 06:08:10.488716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 284/528] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:10 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:10.946671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bc812d70-4472-4771-a395-6f43fcf6fb09 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:10.953126 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bc812d70-4472-4771-a395-6f43fcf6fb09 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:10.953576 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bc812d70-4472-4771-a395-6f43fcf6fb09 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:11.013224 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bc812d70-4472-4771-a395-6f43fcf6fb09 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Going to try to stop instance {{(pid=117665) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 06:08:11.038480 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:11.058114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bc812d70-4472-4771-a395-6f43fcf6fb09 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action" status: 202 len: 0 microversion: 2.1 time: 0.115000 Jun 20 06:08:11.058794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 245/529] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:08:10 2022] POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:08:11.067143 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:11.067900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:11.073949 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:11.074400 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:11.075164 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:11.075599 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:11.201350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:11.209265 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-967e61a8-662d-45e0-a8db-42ff803fcde5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.145973 Jun 20 06:08:11.209829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 285/530] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:11 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:11.506885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:11.507594 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:11.513787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:11.514272 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:11.515035 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:11.515475 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:11.644052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:11.651942 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ab3ab053-c7f9-4330-8bab-84ba913f1a7f tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.149838 Jun 20 06:08:11.652514 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 246/531] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:11 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:12.226738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:12.227368 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:12.233304 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:12.233746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:12.234490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:12.234918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:12.362616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:12.370040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a07fc437-4ca9-4a79-9200-a776f06816e9 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.147705 Jun 20 06:08:12.370602 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 286/532] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:12 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:12.669048 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:12.669660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:12.671934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=34 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:12.677346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:12.677803 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:12.678574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:12.679014 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:12.823767 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:12.831687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a4002a0b-8a1f-4b81-b17b-6efa37ead231 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.166536 Jun 20 06:08:12.832250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 247/533] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:12 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:13.386832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:13.387448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:13.393468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:13.394171 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:13.394924 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:13.395357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:13.520195 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:13.527539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ddf2f2bb-2297-4003-a984-392dfa92281b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.144487 Jun 20 06:08:13.528095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 287/534] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:13 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:13.849973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:13.850507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:13.856964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:13.857438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:13.858189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:13.858620 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:13.985120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:13.993017 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a4578164-f688-4327-a06b-db1de6136e16 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.147540 Jun 20 06:08:13.993590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 248/535] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:13 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:14.544785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:14.545466 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:14.551275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:14.551719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:14.553141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:14.553596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:14.914099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:14.921421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1f227027-1b4b-4fdd-afda-ac60c4101fd5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.380358 Jun 20 06:08:14.921975 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 288/536] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:14 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:15.009862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:15.010472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:15.016837 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:15.017321 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:15.018076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:15.018516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:15.144242 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:15.152159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-52cfd2b5-968b-493d-84ed-c7d6e02cbe58 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.146107 Jun 20 06:08:15.152721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 249/537] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:15 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:15.939217 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:15.939820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:15.946333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:15.946785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:15.947546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:15.947984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:16.076052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:16.083677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-11f063df-1638-4f3e-8484-690bc2ae5271 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.148335 Jun 20 06:08:16.084242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 289/538] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:15 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:16.169457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:16.170064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:16.176388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:16.177356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:16.178118 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:16.178551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:16.305339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:16.313156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c8154a27-6fbd-4a90-9a00-039edaf23fcb tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.147452 Jun 20 06:08:16.313720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 250/539] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:16 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:17.101386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:17.101993 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:17.107907 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:17.108352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:17.109120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:17.109559 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:17.237027 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:17.244338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3bb38b66-b5cb-4e30-b782-57fc1e55c39d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.147500 Jun 20 06:08:17.244892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 290/540] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:17 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:17.330717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:17.331249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:17.342239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:17.342692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:17.343450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:17.343884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:17.469056 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:17.476940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bfa37c9e-8bf0-4003-b402-969b1ebca51c tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.150116 Jun 20 06:08:17.477525 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 251/541] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:17 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:18.261346 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:18.261982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:18.267969 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:18.268409 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:18.269482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:18.269908 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:18.396083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:18.403419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9dd64521-7461-47d9-8c8c-67265ab9c6f5 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.145915 Jun 20 06:08:18.403985 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 291/542] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:18 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:18.493736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:18.494339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:18.500641 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:18.501123 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:18.501879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:18.502305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:18.635896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:18.644841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-39de8cb1-2db9-4c2e-8fe6-7c7a0e747eff tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.154844 Jun 20 06:08:18.646036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 252/543] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:18 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:19.420495 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:19.421072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:19.427631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:19.428082 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:19.428845 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:19.429313 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:19.554851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:19.562181 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9dc18ec-5e27-4e7a-b529-3e1469dcb038 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.145623 Jun 20 06:08:19.562745 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 292/544] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:19 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:19.662562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:19.663172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:19.669525 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:19.669974 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:19.670775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:19.671162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:19.806907 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:19.814691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9aa79ce2-4818-4ca2-82bc-0f44c4bc945d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.156377 Jun 20 06:08:19.815256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 253/545] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:19 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:20.580036 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:20.580808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:20.587643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:20.588089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:20.588864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:20.589322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:20.727588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:20.735055 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d2cb1e79-09cd-49af-a7f4-490faab46b8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.159588 Jun 20 06:08:20.735629 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 293/546] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:20 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:20.831884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:20.832493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:20.838817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:20.839269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:20.840024 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:20.840458 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:20.967439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:20.976040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0c34d799-e848-494f-8dc9-8ffe6cf345d8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.148132 Jun 20 06:08:20.976609 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 254/547] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:20 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:21.752392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:21.753021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:21.759492 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:21.759945 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:21.760708 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:21.761170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:21.886635 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:21.895065 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-74d20315-2661-49c5-aa37-c470c971cc96 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.146455 Jun 20 06:08:21.896252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 294/548] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:21 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:21.912228 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:21.912769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:21.919593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:21.920039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:21.920803 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:21.921269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:21.993069 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:21.993715 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:21.998718 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lazy-loading 'services' on Instance uuid 2264fe9e-b7a3-4884-a67d-33ad6956cb0c {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:08:21.999896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:22.000349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:22.001149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:22.001585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:22.072388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-815a2228-3e58-4ef8-87d2-33d22b00c4de tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c/os-volume_attachments/402e09ac-3da8-4066-b45b-9191a5416b5f" status: 202 len: 0 microversion: 2.1 time: 0.163986 Jun 20 06:08:22.073177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 255/549] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:08:21 2022] DELETE /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c/os-volume_attachments/402e09ac-3da8-4066-b45b-9191a5416b5f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:08:22.144360 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:22.152286 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d7401ab4-a9f3-4fcd-8a22-71f47af4ab85 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1736 microversion: 2.1 time: 0.163110 Jun 20 06:08:22.152846 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 295/550] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:21 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:08:22.916826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:22.917619 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:22.924624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:22.925116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:22.925890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:22.926329 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.077725 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:23.087231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-67f9c7c3-b475-4ea1-8a54-1be81794d607 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.178146 Jun 20 06:08:23.087798 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 256/551] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:22 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:23.169129 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:23.169728 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:23.176036 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.176487 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.177370 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.177888 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.315902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:23.324288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-62414464-5d93-4c02-910a-a90b0c24ed12 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1716 microversion: 2.1 time: 0.158986 Jun 20 06:08:23.324848 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 296/552] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:23 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:23.429064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:23.429559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:23.435437 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.435876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.436627 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.437087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.518871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] HTTP exception thrown: Cannot 'detach_volume' instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 while it is in vm_state rescued Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Request method failure captured: Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments/29b132f3-69d1-4839-ad54-2616c21b85c3 HTTP/1.1 Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3LRl1N6uEvDYwQuC6yEi4EhK2Gn9ZOqOdHje-XDHNZAHEpuUJOukpHa9DFYPYBG_T9C_zv16TCg_z6QtDi9oFzx4J5MS09goz5s9iPGd1zEFHqocpo_RYa9_1eWhdY4EPJ15pkD9E_Ko5fIoO4PbLX4JhABhkN_frtXvy2sb57wYo Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:08:23.521159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0927cd2db94bbfb6155990aef06aa0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 0db0333f0ea245539f27e0d8f27daca3 Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:08:23.522756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Cannot 'detach_volume' instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 while it is in vm_state rescued Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'server_id': '74d7331f-1d20-4a2e-b520-5a6d8a45d112', 'id': '29b132f3-69d1-4839-ad54-2616c21b85c3'} Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:08:23.523499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 while it is in vm_state rescued Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 while it is in vm_state rescued Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:08:23.525013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Returning 409 to user: Cannot 'detach_volume' instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 while it is in vm_state rescued {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:08:23.526302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b0f45a39-a5c3-453d-8af3-e46f3666cc6b tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments/29b132f3-69d1-4839-ad54-2616c21b85c3" status: 409 len: 152 microversion: 2.1 time: 0.097545 Jun 20 06:08:23.526302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 257/553] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:08:23 2022] DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments/29b132f3-69d1-4839-ad54-2616c21b85c3 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:08:23.531353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:23.531891 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:23.537835 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.538289 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.539051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.539501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.553354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:23.604264 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e14d17d8-c724-42c4-92c2-50409a2bee91 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "POST /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/action" status: 202 len: 0 microversion: 2.1 time: 0.076535 Jun 20 06:08:23.605176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 297/554] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:08:23 2022] POST /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:08:23.613287 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:23.613889 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:23.620308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.620758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.621547 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:23.621976 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:23.807599 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:23.819967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8aa82566-0c63-474e-84db-cb8e656bc264 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1724 microversion: 2.1 time: 0.210418 Jun 20 06:08:23.820529 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 258/555] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:23 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:24.106542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:24.107242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:24.109202 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=42 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:24.115697 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.116152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.116927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.117387 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.247949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:24.248528 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:24.255229 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.255680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.256449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.256884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.281993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:08:24.332335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:24.334955 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:24.343348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d0217d6d-4f34-473a-a764-2331adc1f800 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.240884 Jun 20 06:08:24.344489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 298/556] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:24 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:24.364006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-54edbc1d-ee06-4998-a392-a23e03ba3292 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 204 len: 0 microversion: 2.1 time: 0.119609 Jun 20 06:08:24.364592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 259/557] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:08:24 2022] DELETE /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:08:24.372755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:24.373418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:24.379510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.379972 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.380952 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.381409 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.521896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:24.529242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7ff30c54-bc0d-4915-93d3-a7a38bff010f tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1513 microversion: 2.1 time: 0.160295 Jun 20 06:08:24.529799 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 299/558] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:24 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:24.838649 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:24.839353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:24.845495 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.845985 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.846750 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:24.847187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:24.977580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:24.985417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b97c5517-a977-465b-90ed-40b2a4f006b6 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1724 microversion: 2.1 time: 0.151044 Jun 20 06:08:24.985978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 260/559] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:24 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:25.361838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:25.362377 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:25.368380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:25.368820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:25.369594 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:25.370025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:25.495196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:25.502443 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f52f75b1-0b0c-4a18-bcce-dba0518ff82a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.144488 Jun 20 06:08:25.503225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 300/560] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:25 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:25.547154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:25.547758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:25.554150 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:25.554603 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:25.555385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:25.555819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:25.680608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:25.688002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-eb19bcbf-8510-46c5-8497-0c7de07503cf tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1513 microversion: 2.1 time: 0.144643 Jun 20 06:08:25.688669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 261/561] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:25 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:26.002373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:26.003011 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:26.009517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:26.009962 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:26.010710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:26.011133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:26.144544 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:26.152486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1132a954-c1a5-4915-ab16-9d0b4995a383 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1724 microversion: 2.1 time: 0.153892 Jun 20 06:08:26.153072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 301/562] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:25 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:26.521022 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:26.521710 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:26.527712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:26.528167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:26.528931 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:26.529393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:26.656476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:26.664504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6c1017b6-dc37-4fdf-9eea-e056bdfbab3d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.148360 Jun 20 06:08:26.665093 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 262/563] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:26 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:26.705849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:26.706480 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:26.712823 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:26.713299 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:26.714047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:26.714478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:26.851021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:26.858429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5a459403-7a8d-4c11-a79d-938cfa1a0b0c tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1513 microversion: 2.1 time: 0.156379 Jun 20 06:08:26.858992 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 302/564] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:26 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:27.169993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:27.170742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:27.177630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:27.178087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:27.178849 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:27.179423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:27.311746 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:27.320903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4baf310c-ca52-4792-8fe0-7c70aae6ac51 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1724 microversion: 2.1 time: 0.154746 Jun 20 06:08:27.321470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 263/565] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:27 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:27.682633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:27.683247 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:27.689272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:27.689730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:27.690506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:27.690941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:27.857025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:27.865287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-15f5ad17-1c2e-4d28-a0d0-2de95a47e475 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.186425 Jun 20 06:08:27.865870 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 303/566] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:27 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:27.880564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:27.881205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:27.887779 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:27.888223 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:27.889022 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:27.889433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.127046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d70d0517045fca9fbff6eaa846183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef63de6229c418f8fa2dd4c988e5855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:28.135237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6d4f2bc3-383b-4b2a-b990-312652ccb629 tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 200 len: 1513 microversion: 2.1 time: 0.259164 Jun 20 06:08:28.135814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 264/567] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:27 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:28.311397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-d5b8a28b-e6d8-4e45-90ce-89df1269f76c req-1955a0a8-4560-4d20-bfd5-319ae6436d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2264fe9e-b7a3-4884-a67d-33ad6956cb0c", "name": "network-vif-deleted", "tag": "e3be73da-f128-4188-a893-4697bbe0efae"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:28.320316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-d5b8a28b-e6d8-4e45-90ce-89df1269f76c req-1955a0a8-4560-4d20-bfd5-319ae6436d8c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.320783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-d5b8a28b-e6d8-4e45-90ce-89df1269f76c req-1955a0a8-4560-4d20-bfd5-319ae6436d8c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.334665 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-d5b8a28b-e6d8-4e45-90ce-89df1269f76c req-1955a0a8-4560-4d20-bfd5-319ae6436d8c service nova] Creating event network-vif-deleted:e3be73da-f128-4188-a893-4697bbe0efae for instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c on hv-cinder-83699 Jun 20 06:08:28.340468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-d5b8a28b-e6d8-4e45-90ce-89df1269f76c req-1955a0a8-4560-4d20-bfd5-319ae6436d8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032681 Jun 20 06:08:28.340861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:28.341091 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 304/568] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:08:28.341657 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:28.348727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.349204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.350331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.350830 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.485801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:28.496210 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c1c1d07e-fbce-42c7-bfa4-4e90ebd91c94 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1730 microversion: 2.1 time: 0.162083 Jun 20 06:08:28.496778 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 265/569] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:28 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:28.512902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:28.513577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:28.519982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.520470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.521255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.521693 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.596518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-64c73909-6f16-4782-a5b3-abaf0292e1d2 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087803 Jun 20 06:08:28.597146 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 305/570] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:08:28 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:08:28.881705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:28.882334 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:28.888736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.889239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:28.890010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:28.890452 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:29.132526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:29.140052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0c59c726-889e-4b1a-8652-983f5613474e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1679 microversion: 2.1 time: 0.262217 Jun 20 06:08:29.140624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 266/571] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:28 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:29.152233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:29.152840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] [instance: 2264fe9e-b7a3-4884-a67d-33ad6956cb0c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:29.158939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:29.159382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:29.160162 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:29.160593 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:29.174261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] HTTP exception thrown: Instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c could not be found. Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Request method failure captured: Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c HTTP/1.1 Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA5RN8k7w5azfwEWCzPBOT_Gj8sVFD0iTQuwspioLualBSr6L1tsSxdF6eH8C41n8l6M49Y9RS_6Uc9HTM9M17Hf6e-AX360gTYBsWxbB7jkopHj4A7IPj5q4z9AdiWKw7XQltUQwHTR-wLzDTXoMggGbMaLV7_eMhN3Y1p1tqttE0g Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 6ef63de6229c418f8fa2dd4c988e5855 Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotTestJSON-533013377 Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:08:29.175980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ef63de6229c418f8fa2dd4c988e5855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ef63de6229c418f8fa2dd4c988e5855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ef63de6229c418f8fa2dd4c988e5855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ef63de6229c418f8fa2dd4c988e5855", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotTestJSON-533013377 Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 6ef63de6229c418f8fa2dd4c988e5855 Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-533013377 Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotTestJSON-533013377-project Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 576d70d0517045fca9fbff6eaa846183 Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotTestJSON-533013377-project Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c could not be found. Jun 20 06:08:29.177366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '2264fe9e-b7a3-4884-a67d-33ad6956cb0c'} Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c could not be found. Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:08:29.178101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c could not be found. Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c could not be found. Jun 20 06:08:29.179391 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:29.180506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] Returning 404 to user: Instance 2264fe9e-b7a3-4884-a67d-33ad6956cb0c could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:08:29.180506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3ddc9d9a-aa83-4fff-9388-016ed7f1d80d tempest-VolumesSnapshotTestJSON-533013377 tempest-VolumesSnapshotTestJSON-533013377-project] 10.222.0.20 "GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c" status: 404 len: 111 microversion: 2.1 time: 0.029214 Jun 20 06:08:29.180506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 306/572] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:29 2022] GET /compute/v2.1/servers/2264fe9e-b7a3-4884-a67d-33ad6956cb0c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:08:30.157543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:30.158064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:30.164948 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:30.165453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:30.166269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:30.166700 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:30.308119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:30.315650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0eb67d2c-afcd-4214-9a09-e4c9874a2fe2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1656 microversion: 2.1 time: 0.161991 Jun 20 06:08:30.316216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 267/573] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:30 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:30.332259 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5ac1ac38-8a21-40c5-a7db-95798202abab tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:30.339132 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5ac1ac38-8a21-40c5-a7db-95798202abab tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:30.339581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5ac1ac38-8a21-40c5-a7db-95798202abab tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:30.355773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-b5e3f34a-2f1a-4bb8-a2bd-e8e024e7ddea req-2f3dd7c6-beda-4a89-b023-327c2861f80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d7331f-1d20-4a2e-b520-5a6d8a45d112", "tag": "5ebb7e6b-277b-4d1f-9454-0ec64cd2a770"}, {"name": "network-changed", "server_uuid": "74d7331f-1d20-4a2e-b520-5a6d8a45d112", "tag": "5ebb7e6b-277b-4d1f-9454-0ec64cd2a770"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:30.363833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5ac1ac38-8a21-40c5-a7db-95798202abab tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Going to try to start instance {{(pid=117666) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 06:08:30.364372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b5e3f34a-2f1a-4bb8-a2bd-e8e024e7ddea req-2f3dd7c6-beda-4a89-b023-327c2861f80b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:30.364821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b5e3f34a-2f1a-4bb8-a2bd-e8e024e7ddea req-2f3dd7c6-beda-4a89-b023-327c2861f80b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:30.375949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-b5e3f34a-2f1a-4bb8-a2bd-e8e024e7ddea req-2f3dd7c6-beda-4a89-b023-327c2861f80b service nova] Creating event network-changed:5ebb7e6b-277b-4d1f-9454-0ec64cd2a770 for instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 on hv-cinder-83699 Jun 20 06:08:30.376466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-b5e3f34a-2f1a-4bb8-a2bd-e8e024e7ddea req-2f3dd7c6-beda-4a89-b023-327c2861f80b service nova] Creating event network-changed:5ebb7e6b-277b-4d1f-9454-0ec64cd2a770 for instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 on hv-cinder-83699 Jun 20 06:08:30.381894 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-b5e3f34a-2f1a-4bb8-a2bd-e8e024e7ddea req-2f3dd7c6-beda-4a89-b023-327c2861f80b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.029843 Jun 20 06:08:30.385785 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 268/574] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:08:30.411681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5ac1ac38-8a21-40c5-a7db-95798202abab tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action" status: 202 len: 0 microversion: 2.1 time: 0.082392 Jun 20 06:08:30.413007 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 307/575] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:08:30 2022] POST /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:08:30.421201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:30.421910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:30.432827 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:30.433495 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:30.434387 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:30.434879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:30.942092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:30.949623 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-685ec3d8-654f-4d08-85e7-4a35a6ce9920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1665 microversion: 2.1 time: 0.532881 Jun 20 06:08:30.950197 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 269/576] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:30 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1665 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:31.967415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:31.968035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:31.974226 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:31.974669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:31.975417 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:31.975847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:32.101583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:32.108873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6df5dde4-7050-4b6e-8ac1-396065295b6e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1665 microversion: 2.1 time: 0.145785 Jun 20 06:08:32.109460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 308/577] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:31 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:33.126247 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:33.126881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:33.133865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:33.134316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:33.135073 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:33.135509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:33.262223 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:33.269814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9bfaebac-7e60-4b53-a89a-2c07f9f8cf8f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1665 microversion: 2.1 time: 0.147406 Jun 20 06:08:33.271030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 270/578] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:33 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:34.287236 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:34.287842 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:34.294133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:34.294667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:34.295432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:34.295867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:34.454311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:34.462483 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7ff96b4c-ec49-4f16-b720-37c4f55b59c6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1665 microversion: 2.1 time: 0.179773 Jun 20 06:08:34.463044 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 309/579] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:34 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:35.480049 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:35.480574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:35.486841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:35.487320 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:35.488111 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:35.488549 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:35.618417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:35.625824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8488fd0d-bf3c-41e2-b949-7d0fc2bb8b83 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1669 microversion: 2.1 time: 0.149736 Jun 20 06:08:35.626393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 271/580] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:08:35 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:35.977928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:35.978473 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:35.984345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:35.984789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:35.985581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:35.986012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:36.013447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-698c2064-08bb-4d50-8258-0ebe35535f82 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments/d58a3907-f9aa-488e-ae53-e2ad79194f41" status: 200 len: 194 microversion: 2.20 time: 0.039441 Jun 20 06:08:36.013995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 310/581] 10.222.0.20 () {60 vars in 1453 bytes} [Mon Jun 20 06:08:35 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments/d58a3907-f9aa-488e-ae53-e2ad79194f41 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:08:36.074389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:36.074887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:36.080960 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:36.081457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:36.082247 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:36.083328 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:36.160059 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lazy-loading 'services' on Instance uuid e69f0c75-8247-4de3-9021-72428abdf335 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:08:36.227727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9da82062-9b97-42b4-b13d-211ea68ce46f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments/d58a3907-f9aa-488e-ae53-e2ad79194f41" status: 202 len: 0 microversion: 2.20 time: 0.157344 Jun 20 06:08:36.228380 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 272/582] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jun 20 06:08:36 2022] DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments/d58a3907-f9aa-488e-ae53-e2ad79194f41 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:08:36.237264 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:36.238250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:36.244489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:36.245349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:36.246328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:36.246767 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:36.281346 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ba2588b9-8825-4149-bbec-c50c84540ef8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048588 Jun 20 06:08:36.281942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 311/583] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 20 06:08:36 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:08:37.293936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:37.294978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:37.301144 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:37.301602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:37.302359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:37.302799 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:37.331511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0394cf2e-5333-4c2b-811f-069c57f10426 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042319 Jun 20 06:08:37.332080 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 273/584] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 20 06:08:37 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:08:38.343917 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:38.344755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:38.350854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:38.351535 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:38.352460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:38.352903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:38.382305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a5469d83-db10-4d2f-911e-c26ab0732be0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042378 Jun 20 06:08:38.382851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 312/585] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 20 06:08:38 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:08:38.439054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:38.439544 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:38.446407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:38.446852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:38.447596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:38.448025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:38.472374 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:08:38.518794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:38.547156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ced494e5-5dff-44f4-b85a-fb1186f6b80b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 204 len: 0 microversion: 2.20 time: 0.111556 Jun 20 06:08:38.547805 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 274/586] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 20 06:08:38 2022] DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:08:38.556589 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:38.557237 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:38.563530 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:38.563976 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:38.564756 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:38.565220 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:38.801889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:38.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:38.811058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:38.812563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:38.813789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-da1b2586-4ff9-4a3f-b42b-9440f85e0b7b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.260993 Jun 20 06:08:38.814355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 313/587] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:38 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:39.832252 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:39.832951 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:39.839421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:39.839868 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:39.840632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:39.841090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:40.020137 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:40.027946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:40.029568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:40.030730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-951add82-be63-45af-a69f-ac1a404fbf1e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.202727 Jun 20 06:08:40.031286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 275/588] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:39 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:41.049868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:41.050496 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:41.062420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:41.063357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:41.064240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:41.065133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:41.198451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:41.206288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:41.207794 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:41.208942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-07048008-b1b3-4c9d-8cd8-b073ba35da49 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.163065 Jun 20 06:08:41.209517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 314/589] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:41 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:42.226954 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:42.227564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:42.233891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:42.234257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:42.235018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:42.235450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:42.365546 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:42.373454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:42.375063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:42.376231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8e291b3a-94f0-4095-9780-95c2c5eaca41 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1723 microversion: 2.20 time: 0.153299 Jun 20 06:08:42.376788 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 276/590] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:42 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:43.398485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:43.399206 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:43.405528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:43.406089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:43.407161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:43.415759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:43.496111 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:43.504137 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:43.506215 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:43.507369 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ba42bf55-8925-434c-bc74-ea1fdf3f9ba5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 200 len: 1655 microversion: 2.20 time: 0.116417 Jun 20 06:08:43.508134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 315/591] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:43 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 1655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:43.575892 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-083d813e-3a65-4fb0-8d2b-1ef09cf9b886 req-cb9f48ef-018a-461c-9ef0-bfe9c1cb1595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69f0c75-8247-4de3-9021-72428abdf335", "name": "network-vif-deleted", "tag": "7c3c8ebc-f945-4a1d-b56b-ae8692d101a1"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:43.581707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:43.586650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-083d813e-3a65-4fb0-8d2b-1ef09cf9b886 req-cb9f48ef-018a-461c-9ef0-bfe9c1cb1595 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:43.587323 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-083d813e-3a65-4fb0-8d2b-1ef09cf9b886 req-cb9f48ef-018a-461c-9ef0-bfe9c1cb1595 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:43.609547 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-083d813e-3a65-4fb0-8d2b-1ef09cf9b886 req-cb9f48ef-018a-461c-9ef0-bfe9c1cb1595 service nova] Creating event network-vif-deleted:7c3c8ebc-f945-4a1d-b56b-ae8692d101a1 for instance e69f0c75-8247-4de3-9021-72428abdf335 on hv-cinder-83699 Jun 20 06:08:43.617465 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-083d813e-3a65-4fb0-8d2b-1ef09cf9b886 req-cb9f48ef-018a-461c-9ef0-bfe9c1cb1595 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045394 Jun 20 06:08:43.618338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 277/592] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:08:44.525575 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:44.526180 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:44.540585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:44.541058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:44.541822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:44.542681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:44.558378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] HTTP exception thrown: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Request method failure captured: Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 HTTP/1.1 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3OXoMuasBvbh5GA6WMM3T1i6iJr0L6CWL1zzM3p02yA_rx5cNTSWo5qnHt8WhO-k66SyK7GEt7CjlZ7qCwvWgvP-no-wToAhiSNohBCfnzCYGk7L-qt2s51M9LJvUBJVTA_e_tSwhg9Tn5iIw_7k6QTrsZ9mgwuDX6igKcOs3OeBg Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:08:44.560322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce606b9c1e514773a7201b9e83a8af69", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 715da00088754d0e8c6ecfa5a2c9b50c Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:08:44.562025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'e69f0c75-8247-4de3-9021-72428abdf335'} Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:08:44.562851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:08:44.564301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:08:44.566472 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Returning 404 to user: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:08:44.567427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a58c127c-2efc-4e75-9249-832b9d81b27c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 404 len: 111 microversion: 2.20 time: 0.046421 Jun 20 06:08:44.568097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 316/593] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:44 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:08:44.577807 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a041cfdf-3f0e-4730-929d-1a3124225980 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '.version_select at 0x7f9d4415b700>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:44.597339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a041cfdf-3f0e-4730-929d-1a3124225980 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230665252" status: 204 len: 0 microversion: 2.20 time: 0.024376 Jun 20 06:08:44.597910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 278/594] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Jun 20 06:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230665252 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:08:45.264727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6e640458-f444-4bce-996c-4d293d8742d6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'create', calling method: .version_select at 0x7f9d441f70d0>, body: {"keypair": {"name": "tempest-keypair-1458256055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZz+Y+Uh43ojcd+JubCDspKgm+M0JUsWWxW55+Aq74TLxNNxu8Iz0N6AgM+mv86vJcyBE7khOdqx6w74V5xNldIJYQbfpm2pwfczHARZEdLnZdjYxh3sMNKev4hXPgmFw=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:45.278735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-6e640458-f444-4bce-996c-4d293d8742d6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for project ce606b9c1e514773a7201b9e83a8af69. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:08:45.282761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-6e640458-f444-4bce-996c-4d293d8742d6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for user 715da00088754d0e8c6ecfa5a2c9b50c and project ce606b9c1e514773a7201b9e83a8af69. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:08:45.306539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6e640458-f444-4bce-996c-4d293d8742d6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045653 Jun 20 06:08:45.307115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 317/595] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Jun 20 06:08:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 06:08:46.788294 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-117596635", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ea7947d-6cbe-4d2d-93eb-f19499429cea"}], "security_groups": [{"name": "tempest-securitygroup--933077577"}], "key_name": "tempest-keypair-1458256055", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:46.891999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] validate_networks() for [('9ea7947d-6cbe-4d2d-93eb-f19499429cea', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:08:47.251539 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:08:47.251963 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:08:47.252431 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:08:47.252835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:08:47.253307 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:08:47.262000 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:47.262441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:47.263229 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:47.263658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:47.279780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for project ce606b9c1e514773a7201b9e83a8af69. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:08:47.283541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Getting quotas for user 715da00088754d0e8c6ecfa5a2c9b50c and project ce606b9c1e514773a7201b9e83a8af69. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:08:47.294478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:08:47.296764 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:08:47.342290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2ba900e5-c03f-40cf-b806-ab4ceaf0e575 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.558098 Jun 20 06:08:47.342873 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 279/596] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jun 20 06:08:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 06:08:47.354217 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8125a952-7a45-4c6d-9563-126611029c04 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:47.354955 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8125a952-7a45-4c6d-9563-126611029c04 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:47.407107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8125a952-7a45-4c6d-9563-126611029c04 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:47.414833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8125a952-7a45-4c6d-9563-126611029c04 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:47.416501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8125a952-7a45-4c6d-9563-126611029c04 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:47.417646 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8125a952-7a45-4c6d-9563-126611029c04 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1281 microversion: 2.20 time: 0.068486 Jun 20 06:08:47.418194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 318/597] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:47 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:48.436347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:48.437343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:48.445770 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:48.446290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:48.447307 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:48.448497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:48.789280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:48.797872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:48.799595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:48.800705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7d973e6f-8cda-4411-914f-64b12dc04546 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1341 microversion: 2.20 time: 0.368935 Jun 20 06:08:48.801296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 280/598] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:48 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1341 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:49.820103 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:49.820808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:49.828052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:49.828507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:49.829325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:49.829765 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:50.074114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:50.082467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:50.083989 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:50.085127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6d67091c-745e-4644-81b5-1ae944a31e89 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.269611 Jun 20 06:08:50.086064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 319/599] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:49 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:50.463887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-56a0c603-e807-41ad-8ccd-774fe14548b5 req-d3bfc027-56ce-43b7-8bcf-4f31dc3c08c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:50.476362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-56a0c603-e807-41ad-8ccd-774fe14548b5 req-d3bfc027-56ce-43b7-8bcf-4f31dc3c08c2 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:50.477754 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-56a0c603-e807-41ad-8ccd-774fe14548b5 req-d3bfc027-56ce-43b7-8bcf-4f31dc3c08c2 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:50.493790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-56a0c603-e807-41ad-8ccd-774fe14548b5 req-d3bfc027-56ce-43b7-8bcf-4f31dc3c08c2 service nova] Creating event network-changed:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:08:50.498684 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-56a0c603-e807-41ad-8ccd-774fe14548b5 req-d3bfc027-56ce-43b7-8bcf-4f31dc3c08c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044893 Jun 20 06:08:50.499303 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 281/600] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:08:51.103631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:51.104230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:51.110182 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:51.110631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:51.111389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:51.111847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:51.242476 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:51.250227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:51.251709 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:51.252797 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9eea5972-dc1c-4af3-a209-910684477198 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.153598 Jun 20 06:08:51.253378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 320/601] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:51 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:52.272930 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:52.274554 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:52.285502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:52.286943 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:52.288493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:52.289811 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:52.496704 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:52.504818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:52.506413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:52.507517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-192f8f9c-1314-490f-bd06-0a5d8c44b876 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.240684 Jun 20 06:08:52.508611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 282/602] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:52 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:53.525554 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:53.526865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:53.533638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:53.534424 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:53.535469 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:53.535977 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:53.751459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:53.761671 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:53.763723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:53.766818 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-85f759bf-0045-4b01-81c8-7ebe3a1656f0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.245522 Jun 20 06:08:53.777740 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 321/603] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:53 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:54.785295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:54.786261 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:54.793516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:54.794454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:54.796103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:54.796962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:54.943089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:54.954720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:54.956415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:54.957890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-954c0f43-c511-4747-a36f-416a02b6c6da tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.176619 Jun 20 06:08:54.969436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 283/604] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:54 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:55.765439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-c698a928-a2f6-400f-b14b-0bf145974c5e req-d560804a-1e05-45fd-bd7b-36e54b4b5e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "name": "network-vif-plugged", "status": "completed", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:55.776793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:55.784113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c698a928-a2f6-400f-b14b-0bf145974c5e req-d560804a-1e05-45fd-bd7b-36e54b4b5e8d service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:55.786484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c698a928-a2f6-400f-b14b-0bf145974c5e req-d560804a-1e05-45fd-bd7b-36e54b4b5e8d service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:55.812503 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-c698a928-a2f6-400f-b14b-0bf145974c5e req-d560804a-1e05-45fd-bd7b-36e54b4b5e8d service nova] Creating event network-vif-plugged:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:08:55.828783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-c698a928-a2f6-400f-b14b-0bf145974c5e req-d560804a-1e05-45fd-bd7b-36e54b4b5e8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066875 Jun 20 06:08:55.830010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 322/605] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:08:55.978206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:55.982114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:55.991089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:55.991630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:55.992673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:55.993487 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:56.199436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:56.211944 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:56.216037 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:56.217438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2933cd0c-e74a-4584-8a25-44b4e9c5c5f5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.245258 Jun 20 06:08:56.218504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 284/606] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:55 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:57.236408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:57.237736 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:57.248712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:57.249426 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:57.250368 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:57.250982 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:57.413694 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:57.434387 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:57.445796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:57.447684 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:57.448894 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-462f8823-8735-4205-8f32-1c44dbea73d4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1406 microversion: 2.20 time: 0.217019 Jun 20 06:08:57.449503 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 323/607] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:57 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:58.466778 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:58.467394 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:58.469964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:58.470612 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:58.476882 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:58.477564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:58.478496 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:58.479092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:58.624230 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:58.633682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:58.635801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:08:58.637160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fb47572e-c944-450b-8b4e-8a519c833741 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1598 microversion: 2.20 time: 0.174225 Jun 20 06:08:58.649994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 285/608] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:08:58 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:08:58.655011 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:08:58.656102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:08:58.662239 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:58.662987 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:58.664405 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:58.665079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:58.751392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7e69d303-0f9b-44ec-a63d-76ee367e7fc8 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100412 Jun 20 06:08:58.753121 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 324/609] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jun 20 06:08:58 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:08:59.836331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-64fbacf6-56bb-4755-97e4-54f6742abcda req-6800c145-bb54-4489-9efb-669adc8b0ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:08:59.847204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-64fbacf6-56bb-4755-97e4-54f6742abcda req-6800c145-bb54-4489-9efb-669adc8b0ff4 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:08:59.847900 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-64fbacf6-56bb-4755-97e4-54f6742abcda req-6800c145-bb54-4489-9efb-669adc8b0ff4 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:08:59.860699 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-64fbacf6-56bb-4755-97e4-54f6742abcda req-6800c145-bb54-4489-9efb-669adc8b0ff4 service nova] Creating event network-changed:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:08:59.868729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-64fbacf6-56bb-4755-97e4-54f6742abcda req-6800c145-bb54-4489-9efb-669adc8b0ff4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035309 Jun 20 06:08:59.869683 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 286/610] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:02.850835 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fbdc033a-a51b-45a9-bbc3-2cd2cb14e00a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Action: 'create', calling method: .version_select at 0x7f9d443c0430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-724460958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/A3YTq4ZWgFHRUmrDuXw0xmoNTxEgQGANSvhcLR9LcJ1/XZrelxPRYwXVoia1aLJz+yIJU8WeMNKgVSJt4BTOjayx3IzjJRggzCtkgSWY0x8FzqydmpEz91uLjq3uOag=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:02.865012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-fbdc033a-a51b-45a9-bbc3-2cd2cb14e00a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for project 888311b555bb436ca9bc99aed66458d5. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:09:02.870588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-fbdc033a-a51b-45a9-bbc3-2cd2cb14e00a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for user 8a4b39d3a27c4077b88cd0802a240b53 and project 888311b555bb436ca9bc99aed66458d5. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:09:02.910273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fbdc033a-a51b-45a9-bbc3-2cd2cb14e00a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.242980 Jun 20 06:09:02.910868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 325/611] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:09:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:08.741071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:08.741690 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:08.748305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:08.748761 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:08.749565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:08.750005 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:08.752562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=51 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:08.830395 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lazy-loading 'services' on Instance uuid 74d7331f-1d20-4a2e-b520-5a6d8a45d112 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:09:08.905387 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-625899e8-c609-42e0-ae6d-c76317852f34 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments/29b132f3-69d1-4839-ad54-2616c21b85c3" status: 202 len: 0 microversion: 2.1 time: 0.168249 Jun 20 06:09:08.906088 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 287/612] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:09:08 2022] DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments/29b132f3-69d1-4839-ad54-2616c21b85c3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:09:08.911073 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=45 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:08.916429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:08.917651 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:08.930621 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:08.931354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:08.932140 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:08.932589 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:08.965010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-76928405-f90f-4efb-b1e4-eda1ab033488 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054693 Jun 20 06:09:08.965617 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 326/613] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:09:08 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:09:09.977844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:09.978972 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:09.985844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:09.986300 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:09.987159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:09.987596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:10.019780 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e68b1403-121f-4a63-b831-72e2bfc1d31e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047620 Jun 20 06:09:10.020359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 288/614] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:09:09 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:09:10.092837 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:10.093459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:10.099544 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:10.099989 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:10.100754 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:10.101836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:10.125691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:09:10.209223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a1fc33d0-cd20-400c-890c-ca7e36c3fa03 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 204 len: 0 microversion: 2.1 time: 0.119813 Jun 20 06:09:10.209891 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 327/615] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:09:10 2022] DELETE /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:09:10.218250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:10.218881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:10.224778 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:10.225292 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:10.226672 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:10.227107 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:10.358075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:10.365417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c86e427c-5fbd-4800-8f25-4cc61a35da3a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1690 microversion: 2.1 time: 0.150904 Jun 20 06:09:10.365987 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 289/616] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:10 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:11.382997 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:11.383697 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:11.389700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:11.390150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:11.390915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:11.391354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:11.526462 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:11.533914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-22241dcb-a113-4cef-b0a5-5497f1c675a9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1690 microversion: 2.1 time: 0.155171 Jun 20 06:09:11.534482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 328/617] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:11 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:12.550928 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:12.551556 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:12.558513 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:12.558958 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:12.559703 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:12.560134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:12.703781 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:12.711773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0b98c809-4069-4a4d-bbe1-20001df1177a tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1690 microversion: 2.1 time: 0.164560 Jun 20 06:09:12.712353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 290/618] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:12 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:13.728513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:13.730687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:13.732792 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=4 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:13.738524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:13.739191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:13.740107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:13.740526 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:13.870743 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:13.878404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-93bd231e-2ec7-4a49-94e7-d4c7abb8ab63 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1690 microversion: 2.1 time: 0.153716 Jun 20 06:09:13.878981 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 329/619] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:13 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:14.894815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:14.895447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:14.897913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:14.903837 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:14.904285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:14.905066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:14.905499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:14.989415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:14.997651 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d4927faf-58c2-4394-9334-df011c852061 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 200 len: 1622 microversion: 2.1 time: 0.106926 Jun 20 06:09:15.004153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 291/620] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:14 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 1622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:15.100569 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-464560bb-a751-4270-a9d5-bfb7d57e5279 req-f1c3f72e-2b59-45ef-8adc-9a19fc508cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d7331f-1d20-4a2e-b520-5a6d8a45d112", "name": "network-vif-deleted", "tag": "5ebb7e6b-277b-4d1f-9454-0ec64cd2a770"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:15.110176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-464560bb-a751-4270-a9d5-bfb7d57e5279 req-f1c3f72e-2b59-45ef-8adc-9a19fc508cf2 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.111012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-464560bb-a751-4270-a9d5-bfb7d57e5279 req-f1c3f72e-2b59-45ef-8adc-9a19fc508cf2 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:15.128142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-464560bb-a751-4270-a9d5-bfb7d57e5279 req-f1c3f72e-2b59-45ef-8adc-9a19fc508cf2 service nova] Creating event network-vif-deleted:5ebb7e6b-277b-4d1f-9454-0ec64cd2a770 for instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 on hv-cinder-83699 Jun 20 06:09:15.133311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-464560bb-a751-4270-a9d5-bfb7d57e5279 req-f1c3f72e-2b59-45ef-8adc-9a19fc508cf2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112485 Jun 20 06:09:15.133911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 330/621] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:15.680597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:15.681646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:15.688488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.688936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:15.689743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.690184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:15.719462 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e2dea286-648d-4a81-a0f7-a340ef16ec67 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042898 Jun 20 06:09:15.720038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 292/622] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:09:15 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:09:15.780148 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:15.780762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:15.787222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.787670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:15.788468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.788902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:15.819381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:09:15.911019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aae9a98f-7610-4c76-8e21-c3c6c698b14f tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 204 len: 0 microversion: 2.1 time: 0.136060 Jun 20 06:09:15.911713 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 331/623] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:09:15 2022] DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:09:15.920955 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:15.921616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:15.929566 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.930036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:15.930815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:15.931338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:16.015694 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:16.016392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: 74d7331f-1d20-4a2e-b520-5a6d8a45d112] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:16.022768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:16.023221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:16.023984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:16.024420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:16.038725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] HTTP exception thrown: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 could not be found. Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Request method failure captured: Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 HTTP/1.1 Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3LRl1N6uEvDYwQuC6yEi4EhK2Gn9ZOqOdHje-XDHNZAHEpuUJOukpHa9DFYPYBG_T9C_zv16TCg_z6QtDi9oFzx4J5MS09goz5s9iPGd1zEFHqocpo_RYa9_1eWhdY4EPJ15pkD9E_Ko5fIoO4PbLX4JhABhkN_frtXvy2sb57wYo Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:09:16.040382 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0927cd2db94bbfb6155990aef06aa0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 0db0333f0ea245539f27e0d8f27daca3 Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 could not be found. Jun 20 06:09:16.042557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '74d7331f-1d20-4a2e-b520-5a6d8a45d112'} Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 could not be found. Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:09:16.043355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 could not be found. Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 could not be found. Jun 20 06:09:16.044590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:16.045777 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Returning 404 to user: Instance 74d7331f-1d20-4a2e-b520-5a6d8a45d112 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:09:16.045777 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-75c8fcb0-b7d8-41d2-9f53-dd96576f8b11 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112" status: 404 len: 111 microversion: 2.1 time: 0.031209 Jun 20 06:09:16.045777 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 332/624] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:16 2022] GET /compute/v2.1/servers/74d7331f-1d20-4a2e-b520-5a6d8a45d112 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:09:16.054313 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1635233c-e95c-4062-8d22-6934298da2a8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '.version_select at 0x7f9d4420b790>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:16.076272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1635233c-e95c-4062-8d22-6934298da2a8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863749973" status: 202 len: 0 microversion: 2.1 time: 0.027173 Jun 20 06:09:16.077027 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 333/625] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 20 06:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863749973 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:09:16.104499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:16.113760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-02867902-9f12-4abb-9fb7-775223eb467e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1675 microversion: 2.1 time: 0.197685 Jun 20 06:09:16.114330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 293/626] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:15 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:17.130840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:17.131486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:17.138580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:17.139035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:17.139797 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:17.140238 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:17.269892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:17.277877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c626b5d8-3cea-43a0-ad44-985e37d7f4bb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1675 microversion: 2.1 time: 0.150926 Jun 20 06:09:17.278422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 334/627] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:17 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:18.294771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:18.295385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:18.301785 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:18.302232 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:18.302988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:18.303459 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:18.434638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:18.442231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e35e41e0-19ca-4152-a0a2-4df083c5243c tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1675 microversion: 2.1 time: 0.151293 Jun 20 06:09:18.442794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 294/628] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:18 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:18.938389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:18.938906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:18.944799 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:18.945290 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:18.946061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:18.946495 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:18.974699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:09:19.057286 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0cd2f316-dc28-46b0-9954-0952e39e1ed1 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 204 len: 0 microversion: 2.1 time: 0.122346 Jun 20 06:09:19.058483 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 335/629] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:09:18 2022] DELETE /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:09:19.066773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:19.067644 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:19.074898 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.075451 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.076305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.076778 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.292706 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:19.301370 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c1aabc36-73fd-49d5-a332-802aa33334f0 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1508 microversion: 2.1 time: 0.239028 Jun 20 06:09:19.302597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 295/630] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:19 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:19.351492 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-3a92c3e3-487f-4b88-b27b-c16981dc3341 req-965cfc16-ced4-4884-a8df-5c6a777b640d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa707d4-de8c-4e79-8ea0-053c93eb13cd", "name": "network-vif-deleted", "tag": "dc8f630b-b725-48f6-98c9-b243bfba84d3"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:19.360072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3a92c3e3-487f-4b88-b27b-c16981dc3341 req-965cfc16-ced4-4884-a8df-5c6a777b640d service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.360513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3a92c3e3-487f-4b88-b27b-c16981dc3341 req-965cfc16-ced4-4884-a8df-5c6a777b640d service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.373315 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-3a92c3e3-487f-4b88-b27b-c16981dc3341 req-965cfc16-ced4-4884-a8df-5c6a777b640d service nova] Creating event network-vif-deleted:dc8f630b-b725-48f6-98c9-b243bfba84d3 for instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd on hv-cinder-83699 Jun 20 06:09:19.379429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-3a92c3e3-487f-4b88-b27b-c16981dc3341 req-965cfc16-ced4-4884-a8df-5c6a777b640d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Jun 20 06:09:19.380836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 336/631] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:19.459834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:19.460359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:19.467264 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.467717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.468494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.468947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.535880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:19.543327 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6234cd42-6266-4efc-841f-e698d3c9892b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1607 microversion: 2.1 time: 0.087440 Jun 20 06:09:19.543904 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 296/632] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:19 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:20.202838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2121553940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-724460958", "security_groups": [{"name": "tempest-secgroup-smoke-1378745963"}], "block_device_mapping_v2": [{"uuid": "5a07724e-4d95-4f98-b21c-28b42e627108", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82f005d7-3296-4650-9513-388af91b26c4"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:20.319499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:20.320201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:20.320936 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] validate_networks() for [('82f005d7-3296-4650-9513-388af91b26c4', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:09:20.328330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.328877 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.329950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.330397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.536828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:20.544888 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f0e52ba1-057c-4506-9da6-bef664312186 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1508 microversion: 2.1 time: 0.229496 Jun 20 06:09:20.545515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 297/633] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:20 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:20.559352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:20.559961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:20.565828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.566282 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.567042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.567479 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.629594 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:20.637064 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6f688040-06b1-43db-83dc-a6a583aa2163 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1607 microversion: 2.1 time: 0.081370 Jun 20 06:09:20.637629 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 298/634] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:20 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1607 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:20.855203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:09:20.855460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:09:20.855953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:09:20.856359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:09:20.856766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:09:20.865422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.865863 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.866650 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.867081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.883434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for project 888311b555bb436ca9bc99aed66458d5. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:09:20.887754 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for user 8a4b39d3a27c4077b88cd0802a240b53 and project 888311b555bb436ca9bc99aed66458d5. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:09:20.942681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:09:20.944845 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a07724e-4d95-4f98-b21c-28b42e627108',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:09:21.067585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3a0105a1-e225-42e4-8db5-bc1b9c378ac6 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.868896 Jun 20 06:09:21.068230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 337/635] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:09:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:09:21.078522 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2515f72a-173e-4ae2-a4ce-6958254ea4d4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:21.079198 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2515f72a-173e-4ae2-a4ce-6958254ea4d4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:21.136002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2515f72a-173e-4ae2-a4ce-6958254ea4d4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:21.142595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2515f72a-173e-4ae2-a4ce-6958254ea4d4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1094 microversion: 2.1 time: 0.067873 Jun 20 06:09:21.143416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 299/636] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:21 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:21.562015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:21.562634 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:21.568933 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:21.569420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:21.570182 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:21.570623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:21.654649 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:21.655409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:21.664427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:21.664968 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:21.666044 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:21.667048 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:21.698784 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:21.699234 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:21.699682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lazy-loading 'fault' on Instance uuid aaa707d4-de8c-4e79-8ea0-053c93eb13cd {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:09:21.762005 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:21.765385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:21.769806 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-359225c4-58c4-4e53-b5cd-e075a2435549 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 200 len: 1328 microversion: 2.1 time: 0.119148 Jun 20 06:09:21.770382 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 300/637] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:21 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:21.772970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-122652e5-bb32-445e-a0b0-aefb530c7861 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1508 microversion: 2.1 time: 0.214996 Jun 20 06:09:21.773558 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 338/638] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:21 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:22.159810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:22.160361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:22.167339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.167797 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.168580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.169026 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.359919 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:22.367268 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7d6b3ee2-7a97-42a3-aa56-99c7f657e6a9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1192 microversion: 2.1 time: 0.211463 Jun 20 06:09:22.367841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 301/639] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:22 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1192 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:22.689922 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-9a9f0ca0-39e8-4061-a87c-c0fabf6e85b1 req-93636a2b-d1b7-4f56-9227-554129140320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb733d9-3273-49d6-b7b5-f65a946ca6a3", "name": "network-vif-deleted", "tag": "1d80a8fa-234f-4299-9923-0c9ff07fe8f0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:22.698572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9a9f0ca0-39e8-4061-a87c-c0fabf6e85b1 req-93636a2b-d1b7-4f56-9227-554129140320 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.699229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9a9f0ca0-39e8-4061-a87c-c0fabf6e85b1 req-93636a2b-d1b7-4f56-9227-554129140320 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.710931 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-9a9f0ca0-39e8-4061-a87c-c0fabf6e85b1 req-93636a2b-d1b7-4f56-9227-554129140320 service nova] Creating event network-vif-deleted:1d80a8fa-234f-4299-9923-0c9ff07fe8f0 for instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 on hv-cinder-83699 Jun 20 06:09:22.715838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-9a9f0ca0-39e8-4061-a87c-c0fabf6e85b1 req-93636a2b-d1b7-4f56-9227-554129140320 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029492 Jun 20 06:09:22.716831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 339/640] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:22.787116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:22.787858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:22.790281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:22.791188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:22.796063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.796472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.797269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.797701 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.812229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.813199 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.814310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] HTTP exception thrown: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Request method failure captured: Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd HTTP/1.1 Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3IbVySGcDCvd_Mh9sodh3E9ZeUAm9-gHUlRB_u5arclNxf45hK7Z2Azfw1qAxn9fb6KOQdP3TyWwTH-RYui9N8EWt0AZCpR33S3sSv7CXFnSKKE7ZF3HRIQiXelZW0lO3h3nLlMRXoBKWjPEq3xOY5i2S7CmOeTQSINJ240ihsBiI Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:09:22.816156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb9ee28e3a9543b3b9f9df141b4845f8", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: a8fcbdaedda84e74b7b2c78415e71d9c Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:09:22.817810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'aaa707d4-de8c-4e79-8ea0-053c93eb13cd'} Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:09:22.818715 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:09:22.820417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:22.821908 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Returning 404 to user: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:09:22.821908 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1ab3f716-ab11-4fa1-8d3d-809945a16760 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 404 len: 111 microversion: 2.1 time: 0.034432 Jun 20 06:09:22.822184 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:22.822184 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:22.822377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 302/641] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:22 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:09:22.832533 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-63600f9d-e37e-4829-a42d-97a9fa426f79 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '.version_select at 0x7f9d44257b80>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:22.855450 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-63600f9d-e37e-4829-a42d-97a9fa426f79 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716686664" status: 202 len: 0 microversion: 2.1 time: 0.031535 Jun 20 06:09:22.856145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 303/642] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 20 06:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716686664 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:09:22.937749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:22.953481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6b18c080-f809-4f0d-9d99-e5330c69b5c8 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 200 len: 1293 microversion: 2.1 time: 0.167392 Jun 20 06:09:22.955078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 340/643] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:22 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:23.384545 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:23.385745 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:23.396843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:23.397336 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:23.398384 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:23.398819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:23.515675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:23.523675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f75f5807-6496-44e6-bc64-77357d4a49ac tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1210 microversion: 2.1 time: 0.143770 Jun 20 06:09:23.524765 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 304/644] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:23 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:23.884171 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1a6c5316-6116-49a7-b708-84982507238b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: .version_select at 0x7f9d4426fa60>, body: {"keypair": {"name": "tempest-keypair-1109244542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsyCSKopVwTSd21U1jWPUpEUcfxfh4sJQRDl7fFkagma3UmNfRKj5FS6Il2zNl3HZvVHrqUz8w2WvnGXAbRCAF6Qf6tejJ9gO7Y/L7COPBDVcP3a+W5V3S0/T+lNsG/Kg=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:23.899581 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-1a6c5316-6116-49a7-b708-84982507238b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:09:23.904129 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-1a6c5316-6116-49a7-b708-84982507238b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for user a8fcbdaedda84e74b7b2c78415e71d9c and project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:09:23.932672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1a6c5316-6116-49a7-b708-84982507238b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052334 Jun 20 06:09:23.933664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 341/645] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:09:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:23.971075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:23.971681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: bbb733d9-3273-49d6-b7b5-f65a946ca6a3] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:23.979818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:23.980463 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:23.981418 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:23.981849 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:23.997867 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] HTTP exception thrown: Instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 could not be found. Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Request method failure captured: Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 HTTP/1.1 Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3LRl1N6uEvDYwQuC6yEi4EhK2Gn9ZOqOdHje-XDHNZAHEpuUJOukpHa9DFYPYBG_T9C_zv16TCg_z6QtDi9oFzx4J5MS09goz5s9iPGd1zEFHqocpo_RYa9_1eWhdY4EPJ15pkD9E_Ko5fIoO4PbLX4JhABhkN_frtXvy2sb57wYo Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:09:23.999655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0927cd2db94bbfb6155990aef06aa0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 0db0333f0ea245539f27e0d8f27daca3 Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 could not be found. Jun 20 06:09:24.001220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'bbb733d9-3273-49d6-b7b5-f65a946ca6a3'} Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 could not be found. Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:09:24.002192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 could not be found. Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 could not be found. Jun 20 06:09:24.003618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:09:24.005658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Returning 404 to user: Instance bbb733d9-3273-49d6-b7b5-f65a946ca6a3 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:09:24.006537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-16dcdd34-3bc4-4eb0-9100-1fd7b1ac00f9 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3" status: 404 len: 111 microversion: 2.1 time: 0.039644 Jun 20 06:09:24.007281 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 305/646] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:23 2022] GET /compute/v2.1/servers/bbb733d9-3273-49d6-b7b5-f65a946ca6a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:09:24.015786 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:24.016359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:24.023419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:24.025670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:24.026557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:24.027077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:24.060836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:09:24.064112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:24.137404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:24.156868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8b853a32-b934-4e2d-996b-2df3b045f650 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 204 len: 0 microversion: 2.1 time: 0.144859 Jun 20 06:09:24.157710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 342/647] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:09:24 2022] DELETE /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:09:24.167296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:24.168126 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:24.174935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:24.175607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:24.176383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:24.176822 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:24.180879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:24.442860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:24.451870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2028bb57-21f1-48c8-91a0-4417d829384d tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.289464 Jun 20 06:09:24.453333 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 306/648] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:24 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:24.542157 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:24.542867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:24.548997 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:24.549474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:24.550241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:24.550905 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:24.759508 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:24.769502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-61baa368-dbd2-4b3d-ba64-dfdc9ca3581c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.231607 Jun 20 06:09:24.770818 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 343/649] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:24 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:24.983425 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-2b921239-c8c2-407f-ab70-f1c455a9eea9 req-18c52a7e-5255-4991-b58e-516a11296d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39cb3098-0dae-49b3-b980-6c5aec56db4b", "tag": "bdb57701-d4f1-44b0-8c33-bfa74e2488df"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:25.014133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-2b921239-c8c2-407f-ab70-f1c455a9eea9 req-18c52a7e-5255-4991-b58e-516a11296d94 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.014624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-2b921239-c8c2-407f-ab70-f1c455a9eea9 req-18c52a7e-5255-4991-b58e-516a11296d94 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.027565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-2b921239-c8c2-407f-ab70-f1c455a9eea9 req-18c52a7e-5255-4991-b58e-516a11296d94 service nova] Creating event network-changed:bdb57701-d4f1-44b0-8c33-bfa74e2488df for instance 39cb3098-0dae-49b3-b980-6c5aec56db4b on hv-cinder-83699 Jun 20 06:09:25.033301 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-2b921239-c8c2-407f-ab70-f1c455a9eea9 req-18c52a7e-5255-4991-b58e-516a11296d94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053814 Jun 20 06:09:25.034431 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 307/650] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:25.346853 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1491259978", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "deefef70-5b87-4a75-bdf1-b7756b040d57"}], "security_groups": [{"name": "tempest-securitygroup--569010457"}], "key_name": "tempest-keypair-1109244542", "user_data": "}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:25.445440 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] validate_networks() for [('deefef70-5b87-4a75-bdf1-b7756b040d57', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:09:25.470097 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:25.470804 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:25.477192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.477727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.479028 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.479481 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.683232 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:25.690776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-76f0faed-b1ca-4c23-aacc-ad5668e887ac tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.224897 Jun 20 06:09:25.691347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 308/651] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:25 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:25.787757 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:25.788443 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:25.795488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.796011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.797050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.797604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.943450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:09:25.943875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:09:25.944384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:09:25.944844 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:09:25.945234 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:09:25.954558 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.955007 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.955810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:25.956261 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:25.972607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:09:25.975967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:25.976600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Getting quotas for user a8fcbdaedda84e74b7b2c78415e71d9c and project bb9ee28e3a9543b3b9f9df141b4845f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:09:25.984189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0720cdbe-0ded-4811-bee7-0ec548a0a7c9 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.200553 Jun 20 06:09:25.984823 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 309/652] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:25 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:25.992004 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:09:25.995034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:09:26.041639 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-18764ea7-ba4d-4ba5-94ff-443fa13cfb91 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698546 Jun 20 06:09:26.042291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 344/653] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:09:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:09:26.052554 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c90f693f-e8b1-40b2-92a3-3cfddbaf1554 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:26.053200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c90f693f-e8b1-40b2-92a3-3cfddbaf1554 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:26.108681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c90f693f-e8b1-40b2-92a3-3cfddbaf1554 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:26.115914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c90f693f-e8b1-40b2-92a3-3cfddbaf1554 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1238 microversion: 2.1 time: 0.067289 Jun 20 06:09:26.116490 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 310/654] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:26 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:26.708164 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:26.708750 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:26.714808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:26.715255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:26.716006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:26.716439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:26.844339 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:26.852206 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ea3b6e65-9a66-4e8f-8ad1-ad9a6719aa10 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.147966 Jun 20 06:09:26.852769 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 345/655] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:26 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:27.001143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:27.001786 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:27.010162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:27.010614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:27.011374 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:27.011816 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:27.133522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:27.134136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:27.138974 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:27.140082 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:27.140530 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:27.141328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:27.141762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:27.146634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b2fcfa96-6930-49df-a420-02eb82f2574d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.149342 Jun 20 06:09:27.147201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 311/656] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:26 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:27.201170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:27.208328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bf1aba98-41b1-4b56-94a3-350e9bcad2c4 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1242 microversion: 2.1 time: 0.078597 Jun 20 06:09:27.208889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 346/657] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:27 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:27.870149 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:27.870752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:27.876636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:27.877114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:27.877864 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:27.878296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:28.004650 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:28.012646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-381c8b64-0fd8-4acf-bdb5-8a9846c7d140 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1522 microversion: 2.1 time: 0.146875 Jun 20 06:09:28.013263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 312/658] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:27 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:28.163611 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:28.164849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:28.172486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:28.173211 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:28.174209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:28.175029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:28.224923 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:28.225877 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:28.233681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:28.234400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:28.235454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:28.236083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:28.366535 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:28.373934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3ae6c28b-ee2c-4ae1-a4db-0b41eb3daa1e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1308 microversion: 2.1 time: 0.152932 Jun 20 06:09:28.374507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 313/659] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:28 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:28.549832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:28.557667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5062db09-6ad7-487f-8c08-87a7ba227a9c tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.397799 Jun 20 06:09:28.565086 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 347/660] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:28 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:28.879168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-01ca2368-bc65-48b2-a7ef-1bf8294d1278 req-dd0ef44d-fade-4586-99f6-f49730169b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14b9a48-4cc1-4fb0-bc59-b22b124b5981", "name": "network-vif-deleted", "tag": "edbb2d3c-34d0-4267-b40a-36ff6134ff90"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:28.888917 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-01ca2368-bc65-48b2-a7ef-1bf8294d1278 req-dd0ef44d-fade-4586-99f6-f49730169b9e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:28.890346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-01ca2368-bc65-48b2-a7ef-1bf8294d1278 req-dd0ef44d-fade-4586-99f6-f49730169b9e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:28.903606 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-01ca2368-bc65-48b2-a7ef-1bf8294d1278 req-dd0ef44d-fade-4586-99f6-f49730169b9e service nova] Creating event network-vif-deleted:edbb2d3c-34d0-4267-b40a-36ff6134ff90 for instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 on hv-cinder-83699 Jun 20 06:09:28.909254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-01ca2368-bc65-48b2-a7ef-1bf8294d1278 req-dd0ef44d-fade-4586-99f6-f49730169b9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034421 Jun 20 06:09:28.910340 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 314/661] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:29.030115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:29.030758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:29.036855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:29.037405 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:29.038176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:29.038616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:29.103859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db0333f0ea245539f27e0d8f27daca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0927cd2db94bbfb6155990aef06aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:29.111781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-758861d2-17e5-49c7-af0e-3fde65a4b17e tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 200 len: 1307 microversion: 2.1 time: 0.086373 Jun 20 06:09:29.112591 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 348/662] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:29 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:29.392514 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:29.393408 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:29.399862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:29.400797 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:29.401590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:29.402017 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:29.538869 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:29.547367 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e13cb647-e91d-4854-9aea-c0fbc41de88e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1363 microversion: 2.1 time: 0.159652 Jun 20 06:09:29.547944 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 315/663] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:29 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:29.575077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:29.575783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:29.582050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:29.582682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:29.583620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:29.584221 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:29.734666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:29.742546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d36d7b0b-8ee1-4122-9a4b-c271570b331f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.171173 Jun 20 06:09:29.743037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 349/664] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:29 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:30.128598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:30.129441 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] [instance: a14b9a48-4cc1-4fb0-bc59-b22b124b5981] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:30.136852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.137343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.138378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.138977 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.160914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] HTTP exception thrown: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 could not be found. Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Request method failure captured: Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 HTTP/1.1 Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3LRl1N6uEvDYwQuC6yEi4EhK2Gn9ZOqOdHje-XDHNZAHEpuUJOukpHa9DFYPYBG_T9C_zv16TCg_z6QtDi9oFzx4J5MS09goz5s9iPGd1zEFHqocpo_RYa9_1eWhdY4EPJ15pkD9E_Ko5fIoO4PbLX4JhABhkN_frtXvy2sb57wYo Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:09:30.163397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0927cd2db94bbfb6155990aef06aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0927cd2db94bbfb6155990aef06aa0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 3f0927cd2db94bbfb6155990aef06aa0 Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1134252521 Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 0db0333f0ea245539f27e0d8f27daca3 Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1134252521-project Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 could not be found. Jun 20 06:09:30.164939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'a14b9a48-4cc1-4fb0-bc59-b22b124b5981'} Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 could not be found. Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:09:30.165836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 could not be found. Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 could not be found. Jun 20 06:09:30.167571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:09:30.170877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] Returning 404 to user: Instance a14b9a48-4cc1-4fb0-bc59-b22b124b5981 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:09:30.171930 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-88faf1f7-cebc-4f4a-a1e7-4e32de7ea792 tempest-ServerRescueNegativeTestJSON-1134252521 tempest-ServerRescueNegativeTestJSON-1134252521-project] 10.222.0.20 "GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981" status: 404 len: 111 microversion: 2.1 time: 0.047514 Jun 20 06:09:30.173034 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 350/665] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:30 2022] GET /compute/v2.1/servers/a14b9a48-4cc1-4fb0-bc59-b22b124b5981 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:09:30.180874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-b1cd28e2-5029-4512-8501-806e33232224 req-92a256c5-bd1a-4fd3-9a3c-f005d938ef5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13906ca2-b15e-4c2e-8079-b5a30b4edf86", "tag": "eeec6141-d200-4a28-9270-09f919342290"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:30.190741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b1cd28e2-5029-4512-8501-806e33232224 req-92a256c5-bd1a-4fd3-9a3c-f005d938ef5a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.191259 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b1cd28e2-5029-4512-8501-806e33232224 req-92a256c5-bd1a-4fd3-9a3c-f005d938ef5a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.203530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-b1cd28e2-5029-4512-8501-806e33232224 req-92a256c5-bd1a-4fd3-9a3c-f005d938ef5a service nova] Creating event network-changed:eeec6141-d200-4a28-9270-09f919342290 for instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 on hv-cinder-83699 Jun 20 06:09:30.208356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-b1cd28e2-5029-4512-8501-806e33232224 req-92a256c5-bd1a-4fd3-9a3c-f005d938ef5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126849 Jun 20 06:09:30.209058 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 316/666] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:30.565098 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:30.565749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:30.572000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.572453 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.573250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.573690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.760382 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:30.761133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:30.767416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.767870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.768914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:30.769387 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:30.858339 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:30.865287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-eb54a29c-e565-4b19-82d9-4c0c9b626d27 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1363 microversion: 2.1 time: 0.304182 Jun 20 06:09:30.865857 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 351/667] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:30 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:30.981296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:30.988604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5d6a2964-0839-4db1-9444-aa2981fc4958 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.232929 Jun 20 06:09:30.989200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 317/668] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:30 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:31.882208 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:31.883464 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:31.890498 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:31.891024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:31.891855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:31.892357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:32.005250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:32.006587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:32.013290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:32.013737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:32.014502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:32.014936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:32.133482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:32.141237 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aefb14e7-63d0-4ea3-ae07-77889bc614a6 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1363 microversion: 2.1 time: 0.262838 Jun 20 06:09:32.141810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 352/669] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:31 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:32.221408 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:32.230537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cf233c93-2469-4688-97ee-2398d6d22b05 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.229136 Jun 20 06:09:32.232206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 318/670] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:32 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:33.159191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:33.159980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:33.166909 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:33.167914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:33.168945 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:33.169630 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:33.248675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:33.250083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:33.257887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:33.258608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:33.259374 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:33.260506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:33.392485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:33.402796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f2d314fa-186b-4faa-a4d6-672a0ec2dd88 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1363 microversion: 2.1 time: 0.248156 Jun 20 06:09:33.404404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 353/671] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:33 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:33.453485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:33.461332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1569fdf1-2f68-4217-b4fd-f05335c23be7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.217304 Jun 20 06:09:33.461914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 319/672] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:33 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:33.884201 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-2a18d62d-235c-4ddc-8fee-3409bac5d49e req-260d2012-803c-45df-ba1a-3b9dc5bc7459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13906ca2-b15e-4c2e-8079-b5a30b4edf86", "name": "network-vif-plugged", "status": "completed", "tag": "eeec6141-d200-4a28-9270-09f919342290"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:33.901278 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-2a18d62d-235c-4ddc-8fee-3409bac5d49e req-260d2012-803c-45df-ba1a-3b9dc5bc7459 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:33.902256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-2a18d62d-235c-4ddc-8fee-3409bac5d49e req-260d2012-803c-45df-ba1a-3b9dc5bc7459 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:33.914801 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-2a18d62d-235c-4ddc-8fee-3409bac5d49e req-260d2012-803c-45df-ba1a-3b9dc5bc7459 service nova] Creating event network-vif-plugged:eeec6141-d200-4a28-9270-09f919342290 for instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 on hv-cinder-83699 Jun 20 06:09:33.921851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-2a18d62d-235c-4ddc-8fee-3409bac5d49e req-260d2012-803c-45df-ba1a-3b9dc5bc7459 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044883 Jun 20 06:09:33.924683 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 354/673] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:34.421066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:34.422441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:34.429305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:34.430066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:34.431102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:34.431827 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:34.479744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:34.480451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:34.486875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:34.487326 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:34.488347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:34.488827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:34.632889 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:34.641100 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8925ab8c-0c22-4660-b5e7-d9bce0969bf7 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1363 microversion: 2.1 time: 0.224602 Jun 20 06:09:34.641795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 320/674] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:34 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:34.665033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:34.672469 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9c00057c-6deb-4cae-8978-a0dfb32bad41 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.197495 Jun 20 06:09:34.673048 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 355/675] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:34 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:35.659043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:35.659773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:35.667264 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:35.667747 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:35.668866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:35.669361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:35.689562 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:35.690175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:35.699824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:35.700793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:35.701955 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:35.703458 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:35.926837 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:35.938077 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-56b6cf23-1da7-4a60-83a0-ca1a8c3c9394 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1363 microversion: 2.1 time: 0.283564 Jun 20 06:09:35.938983 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 321/676] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:35 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:35.960439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:35.964157 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=4 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:35.968722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6d64994c-8b70-45d1-b07d-4452b573a054 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.282905 Jun 20 06:09:35.969438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 356/677] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:35 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:36.955706 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:36.956355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:36.958662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:36.968072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:36.969741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:36.970948 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:36.971400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:36.985624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:36.986933 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:36.993178 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=16 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:36.999528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:37.000211 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:37.001225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:37.001956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:37.175288 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:37.183819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cfd82f82-502b-4e93-a602-86d1544cc6bc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1550 microversion: 2.1 time: 0.231984 Jun 20 06:09:37.184392 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 322/678] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:36 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1550 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:37.200266 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:37.203521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:37.207249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:37.211188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-522b36b4-30f3-499a-9518-69f0800a844a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.229365 Jun 20 06:09:37.211850 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 357/679] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:36 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:37.221072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:37.221072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:37.221072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:37.221072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:37.295248 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8f59475e-0442-42d4-aef2-e5c9c777d182 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099123 Jun 20 06:09:37.295924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 323/680] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:09:37 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:09:38.228251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:38.230333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:38.238813 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:38.239432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:38.240400 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:38.240847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:38.443167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-fe13dbc4-f4f8-4145-86d4-8febed7dac32 req-348beb93-f561-419b-8a02-373aca3db0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39cb3098-0dae-49b3-b980-6c5aec56db4b", "name": "network-vif-plugged", "status": "completed", "tag": "bdb57701-d4f1-44b0-8c33-bfa74e2488df"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:38.452377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-fe13dbc4-f4f8-4145-86d4-8febed7dac32 req-348beb93-f561-419b-8a02-373aca3db0d7 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:38.452905 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-fe13dbc4-f4f8-4145-86d4-8febed7dac32 req-348beb93-f561-419b-8a02-373aca3db0d7 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:38.465675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-fe13dbc4-f4f8-4145-86d4-8febed7dac32 req-348beb93-f561-419b-8a02-373aca3db0d7 service nova] Creating event network-vif-plugged:bdb57701-d4f1-44b0-8c33-bfa74e2488df for instance 39cb3098-0dae-49b3-b980-6c5aec56db4b on hv-cinder-83699 Jun 20 06:09:38.472345 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-fe13dbc4-f4f8-4145-86d4-8febed7dac32 req-348beb93-f561-419b-8a02-373aca3db0d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177444 Jun 20 06:09:38.473226 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 324/681] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:09:38.555101 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:38.564060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-14fa7520-fbde-48a3-8ccc-4416fb858297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.340023 Jun 20 06:09:38.568147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 358/682] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:38 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:39.224730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-82585a14-6a9a-41a5-a332-b1248c1c1cae req-d152a4a8-e2aa-46b9-b05e-227ecdc9a59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13906ca2-b15e-4c2e-8079-b5a30b4edf86", "tag": "eeec6141-d200-4a28-9270-09f919342290"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:39.242438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-82585a14-6a9a-41a5-a332-b1248c1c1cae req-d152a4a8-e2aa-46b9-b05e-227ecdc9a59f service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:39.245457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-82585a14-6a9a-41a5-a332-b1248c1c1cae req-d152a4a8-e2aa-46b9-b05e-227ecdc9a59f service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:39.257318 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-82585a14-6a9a-41a5-a332-b1248c1c1cae req-d152a4a8-e2aa-46b9-b05e-227ecdc9a59f service nova] Creating event network-changed:eeec6141-d200-4a28-9270-09f919342290 for instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 on hv-cinder-83699 Jun 20 06:09:39.262886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-82585a14-6a9a-41a5-a332-b1248c1c1cae req-d152a4a8-e2aa-46b9-b05e-227ecdc9a59f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042096 Jun 20 06:09:39.264183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 325/683] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:39.586592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:39.588468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:39.598249 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:39.599061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:39.600770 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:39.601577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:39.989117 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:39.992850 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:39.998025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-56564c5d-f7c2-44e1-a6c9-3a4b6616fa03 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1266 microversion: 2.1 time: 0.420343 Jun 20 06:09:39.998881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 359/684] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:39 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1266 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:40.507692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-397bc262-5cb6-41dc-aaa4-c458a77df018 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: .version_select at 0x7f9d4428d820>, body: {"keypair": {"name": "tempest-keypair-1954187817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKEEi468tOXOb8WD/p+2F0clu4m6bwylC3vHahQCiBaraxlWRvm4EbA2SQ7Ix/CcSlTNahXLWv3iDU3xrQw0xmszc7o6khbMYYwlpoPEC0qSVFogBSjQpVEHDkvDV4rwg=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:40.526376 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-397bc262-5cb6-41dc-aaa4-c458a77df018 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:09:40.530573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-397bc262-5cb6-41dc-aaa4-c458a77df018 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:09:40.566742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-397bc262-5cb6-41dc-aaa4-c458a77df018 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129255 Jun 20 06:09:40.567483 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 326/685] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:09:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:41.015420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:41.016914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:41.024841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:41.026231 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:41.027264 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:41.027766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:41.191803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:41.203700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8db9a080-8799-46d4-a309-1567e008ca33 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1454 microversion: 2.1 time: 0.192230 Jun 20 06:09:41.204291 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 360/686] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:41 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1454 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:41.220456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:41.225559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:41.234260 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:41.235159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:41.235949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:41.237523 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:41.397698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:41.405669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1bbd1475-8acf-45ee-8ea6-20b316314acd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1454 microversion: 2.1 time: 0.189052 Jun 20 06:09:41.406250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 327/687] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:41 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:42.004626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1924358547", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dfe8112-b1c3-4379-ace8-53ea74527bdb"}], "security_groups": [{"name": "tempest-securitygroup--285366461"}], "key_name": "tempest-keypair-1954187817", "user_data": "}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:42.171229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] validate_networks() for [('5dfe8112-b1c3-4379-ace8-53ea74527bdb', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:09:43.250108 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:09:43.251448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:09:43.252183 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:09:43.252753 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:09:43.253397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:09:43.266132 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:43.266132 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:43.266879 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:43.267329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:43.285445 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:09:43.289791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:09:43.301853 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:09:43.304373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:09:43.354361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8fc49897-52ce-4972-8ed8-ea92a3626bb8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.355005 Jun 20 06:09:43.357133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 361/688] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:09:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:09:43.365310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-50c4ba41-4e60-4c0b-8134-37a41f7c33c3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:43.365962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-50c4ba41-4e60-4c0b-8134-37a41f7c33c3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:43.485598 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50c4ba41-4e60-4c0b-8134-37a41f7c33c3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:43.498405 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-50c4ba41-4e60-4c0b-8134-37a41f7c33c3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1242 microversion: 2.1 time: 0.137117 Jun 20 06:09:43.499894 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 328/689] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:43 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:44.074660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-68a1def5-0d8d-49a0-97bc-de7b4634290b req-20408326-49d5-401a-8d91-ad8058371d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39cb3098-0dae-49b3-b980-6c5aec56db4b", "tag": "bdb57701-d4f1-44b0-8c33-bfa74e2488df"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:44.085185 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-68a1def5-0d8d-49a0-97bc-de7b4634290b req-20408326-49d5-401a-8d91-ad8058371d9b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:44.086133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-68a1def5-0d8d-49a0-97bc-de7b4634290b req-20408326-49d5-401a-8d91-ad8058371d9b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:44.101240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-68a1def5-0d8d-49a0-97bc-de7b4634290b req-20408326-49d5-401a-8d91-ad8058371d9b service nova] Creating event network-changed:bdb57701-d4f1-44b0-8c33-bfa74e2488df for instance 39cb3098-0dae-49b3-b980-6c5aec56db4b on hv-cinder-83699 Jun 20 06:09:44.106896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-68a1def5-0d8d-49a0-97bc-de7b4634290b req-20408326-49d5-401a-8d91-ad8058371d9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037545 Jun 20 06:09:44.107970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 362/690] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:44.297019 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:44.297518 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:44.306646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:44.307164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:44.308575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:44.309269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:44.324028 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:44.335090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d285d8a4-8959-4bab-81b4-e2088a89a229 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/ips" status: 200 len: 151 microversion: 2.20 time: 0.180430 Jun 20 06:09:44.335896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 329/691] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jun 20 06:09:44 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/ips => generated 151 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:09:44.517536 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:44.523985 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:44.537529 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:44.539205 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:44.541376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:44.542886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:44.679518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:44.701493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-49daf02f-f284-421f-a194-8ffd0664d28e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1294 microversion: 2.1 time: 0.188496 Jun 20 06:09:44.702112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 363/692] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:44 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:45.722058 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:45.723389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:45.726594 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:45.734655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:45.735454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:45.736581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:45.737252 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:45.985573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:45.992921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-28b8f289-4657-4164-bc1e-7dd801486fa2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.277410 Jun 20 06:09:45.994028 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 330/693] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:45 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:46.265455 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:46.266009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:46.274387 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:46.274854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:46.275650 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:46.276082 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:46.300222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lazy-loading 'flavor' on Instance uuid 3b3cf00c-e900-44c9-abe3-75093e0f71dd {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:09:46.329942 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-bf284d7a-b836-4853-b562-786f97bb4875 req-5d8aa185-26de-45be-934d-03982b7dcdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d4998a-6c49-45ad-9768-8df93ecacb8d", "tag": "b57b3f8b-bd03-4e93-90cf-ffffd34a640a"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:46.341520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-bf284d7a-b836-4853-b562-786f97bb4875 req-5d8aa185-26de-45be-934d-03982b7dcdbd service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:46.342504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-bf284d7a-b836-4853-b562-786f97bb4875 req-5d8aa185-26de-45be-934d-03982b7dcdbd service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:46.384239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-bf284d7a-b836-4853-b562-786f97bb4875 req-5d8aa185-26de-45be-934d-03982b7dcdbd service nova] Creating event network-changed:b57b3f8b-bd03-4e93-90cf-ffffd34a640a for instance 66d4998a-6c49-45ad-9768-8df93ecacb8d on hv-cinder-83699 Jun 20 06:09:46.390098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-bf284d7a-b836-4853-b562-786f97bb4875 req-5d8aa185-26de-45be-934d-03982b7dcdbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065342 Jun 20 06:09:46.391103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 331/694] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:46.635001 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b7f510b2-09f1-4d25-b009-599bb8f325f4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/action" status: 202 len: 0 microversion: 2.20 time: 0.374262 Jun 20 06:09:46.638578 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 364/695] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 20 06:09:46 2022] POST /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:09:46.644464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:46.645873 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:46.654027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:46.654475 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:46.655257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:46.655903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:46.788804 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:46.797418 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:46.798910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:46.800088 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-079be624-0565-4ce4-83cf-a731a9e681c2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.160143 Jun 20 06:09:46.800635 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 332/696] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:46 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:47.011700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:47.012397 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:47.018868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:47.019297 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:47.020052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:47.020486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:47.148722 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:47.156744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-eafa27ea-6f4c-4182-8e55-2b60daf4dd4f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.149749 Jun 20 06:09:47.157345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 365/697] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:47 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:47.817740 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:47.818338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:47.824841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:47.825321 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:47.826074 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:47.826499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:47.989007 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:47.998658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:48.000459 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:48.001756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7d205699-86a9-42f7-98ea-b772e59af4c4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.187978 Jun 20 06:09:48.002322 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 333/698] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:47 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:09:48.173283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:48.174088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:48.182169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:48.183152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:48.184114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:48.184551 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:48.568461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:48.576363 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-052c3c5d-66ce-4e4e-ae2d-5336108f115e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.407043 Jun 20 06:09:48.577093 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 366/699] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:48 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:49.019903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:49.020514 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:49.027559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:49.028009 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:49.028761 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:49.029228 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:49.154673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:49.162499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:49.164000 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:49.165783 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-75556b23-ba36-4a39-b917-d07dc2c63fcd tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.149446 Jun 20 06:09:49.166358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 334/700] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:49 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:09:49.594122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:49.594657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:49.600637 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:49.601114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:49.601865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:49.602293 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:49.732632 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:49.740014 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-49b49ec5-df5c-4be4-b6c2-ce89a1c67991 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.149787 Jun 20 06:09:49.740672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 367/701] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:49 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:50.184891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:50.185478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:50.192776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:50.193262 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:50.194038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:50.194476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:50.328313 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:50.336250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:50.337796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:50.338956 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e070dbf9-7c64-45ef-923a-b3a842538021 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.158807 Jun 20 06:09:50.339520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 335/702] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:50 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:09:50.757362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:50.757971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:50.764383 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:50.764829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:50.765627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:50.766057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:50.895617 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:50.903547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-654a682d-33e3-4489-8346-01fee4546c4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.149985 Jun 20 06:09:50.904124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 368/703] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:50 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:51.174462 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:51.174991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:51.181527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.181975 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.182724 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.183158 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.205107 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lazy-loading 'flavor' on Instance uuid 3b0826f2-7616-4a05-a32b-799ae83cda42 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:09:51.274749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9baf8553-a894-47af-8994-89580538d399 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "POST /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42/action" status: 202 len: 0 microversion: 2.1 time: 0.103985 Jun 20 06:09:51.275314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 336/704] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:09:51 2022] POST /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:09:51.283398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:51.284071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:51.290346 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.290795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.291627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.292064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.357882 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:51.358645 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:51.364961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.365451 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.366203 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.366638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.448954 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:51.456659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-347b6dd0-3595-40ba-a2e5-e83642555175 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.177105 Jun 20 06:09:51.457256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 369/705] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:51 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:51.513300 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:51.521358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:51.522849 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:51.524005 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-36518812-cfd2-44e8-bfde-ca8415ff07c1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.170536 Jun 20 06:09:51.524841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 337/706] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:51 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:51.750886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-ae37657b-516d-4e79-8cc2-e81a499bf0ec req-244b453c-144a-4669-a2a7-ccda07d51018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d4998a-6c49-45ad-9768-8df93ecacb8d", "name": "network-vif-plugged", "status": "completed", "tag": "b57b3f8b-bd03-4e93-90cf-ffffd34a640a"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:51.759366 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ae37657b-516d-4e79-8cc2-e81a499bf0ec req-244b453c-144a-4669-a2a7-ccda07d51018 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.759961 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ae37657b-516d-4e79-8cc2-e81a499bf0ec req-244b453c-144a-4669-a2a7-ccda07d51018 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.771273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-ae37657b-516d-4e79-8cc2-e81a499bf0ec req-244b453c-144a-4669-a2a7-ccda07d51018 service nova] Creating event network-vif-plugged:b57b3f8b-bd03-4e93-90cf-ffffd34a640a for instance 66d4998a-6c49-45ad-9768-8df93ecacb8d on hv-cinder-83699 Jun 20 06:09:51.776040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-ae37657b-516d-4e79-8cc2-e81a499bf0ec req-244b453c-144a-4669-a2a7-ccda07d51018 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028918 Jun 20 06:09:51.776822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 370/707] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:09:51.920630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:51.921601 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:51.928260 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.928703 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:51.929516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:51.929946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:52.114829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:52.122194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9c07ffba-4c09-4471-9741-70bcfd8c6eb5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.205441 Jun 20 06:09:52.122767 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 338/708] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:51 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:52.474448 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:52.475150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:52.481352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:52.481805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:52.482562 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:52.482999 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:52.541887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:52.542493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:52.548834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:52.549318 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:52.550083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:52.550520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:52.655456 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:52.663005 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f3e3ac67-c0a4-4092-a78c-4702e13b0ead tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.192728 Jun 20 06:09:52.663582 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 371/709] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:52 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:52.698609 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:52.706439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:52.707947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:52.709136 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f8790704-5c00-4486-baa3-5f2ee3f8eaa4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.171102 Jun 20 06:09:52.709688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 339/710] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:52 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:53.139433 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:53.140072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:53.146380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:53.146826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:53.147570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:53.148001 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:53.277836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:53.280116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:53.286645 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5d706608-e391-4ab5-8419-a6bc64ad57a4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1367 microversion: 2.1 time: 0.150931 Jun 20 06:09:53.287142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 372/711] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:53 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:53.679809 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:53.680415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:53.682879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:53.688510 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:53.688961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:53.689743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:53.690180 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:53.726836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:53.727440 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:53.730027 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:53.735657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:53.736113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:53.736893 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:53.737357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:53.868918 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:53.876754 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1e86bc2e-d2f9-45af-921e-375bfcc307be tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.200730 Jun 20 06:09:53.877357 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 340/712] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:53 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:53.903848 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:53.911710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:53.913318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:53.914484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fcc7adfd-9e3e-4d7f-8800-0b011fcc728c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.191530 Jun 20 06:09:53.915772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 373/713] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:53 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:54.303373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:54.303975 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:54.309994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.310446 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.311194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.311625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.442509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:54.449814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a75724c4-5514-4003-b2b9-00a5c7e66b04 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1558 microversion: 2.1 time: 0.150228 Jun 20 06:09:54.450389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 341/714] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:54 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:54.466462 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:54.466954 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:54.472927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.473410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.474168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.474605 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.551190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e28b9a32-a170-468b-b0f2-5798a31d075b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089041 Jun 20 06:09:54.551784 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 374/715] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:09:54 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:54.894104 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:54.894720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:54.901111 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.901570 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.902334 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.902775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.934502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:54.935254 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:54.937118 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:54.942362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.942842 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:54.943600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:54.944061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:55.200114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:55.207536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dd862e66-c426-47d9-b143-7ea365aa482d tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.317524 Jun 20 06:09:55.208112 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 342/716] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:54 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:55.257656 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:55.265464 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:55.266943 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:55.268352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7d555297-6ebb-402f-9a1a-5235c861ac6b tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.338212 Jun 20 06:09:55.268946 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 375/717] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:54 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:09:55.604360 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-4ca2e112-ba92-47c2-883a-8338f905e3d6 req-4d997d49-fa51-44d3-8296-bc8a839dc52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d4998a-6c49-45ad-9768-8df93ecacb8d", "tag": "b57b3f8b-bd03-4e93-90cf-ffffd34a640a"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:09:55.612439 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-4ca2e112-ba92-47c2-883a-8338f905e3d6 req-4d997d49-fa51-44d3-8296-bc8a839dc52b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:55.612876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-4ca2e112-ba92-47c2-883a-8338f905e3d6 req-4d997d49-fa51-44d3-8296-bc8a839dc52b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:55.624331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-4ca2e112-ba92-47c2-883a-8338f905e3d6 req-4d997d49-fa51-44d3-8296-bc8a839dc52b service nova] Creating event network-changed:b57b3f8b-bd03-4e93-90cf-ffffd34a640a for instance 66d4998a-6c49-45ad-9768-8df93ecacb8d on hv-cinder-83699 Jun 20 06:09:55.629319 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-4ca2e112-ba92-47c2-883a-8338f905e3d6 req-4d997d49-fa51-44d3-8296-bc8a839dc52b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029101 Jun 20 06:09:55.630088 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 343/718] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:56.224118 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:56.224728 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:56.230650 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:56.231100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:56.231984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:56.232431 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:56.287383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:56.288084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:56.295840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:56.296296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:56.297095 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:56.297530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:56.406725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:56.410374 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:56.415687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2cddb1a9-6dde-491b-a9b1-30fe70be5391 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.195348 Jun 20 06:09:56.416466 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 376/719] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:56 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:56.454177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:56.462365 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:56.464366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:56.465607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d98d4512-cff8-4f1f-a97d-e2ef7d4e1c9e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.182991 Jun 20 06:09:56.466180 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 344/720] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:56 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:57.433367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:57.433963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:57.440898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:57.441406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:57.442209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:57.442644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:57.483862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:57.484663 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:57.491232 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:57.491685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:57.492447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:57.492900 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:57.628081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:57.635949 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aab5ec7b-0a6c-4fec-82a9-42e7a1faadce tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.207217 Jun 20 06:09:57.636863 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 377/721] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:57 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:57.657588 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:57.659913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:57.667538 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:57.669093 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:57.670294 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9b9ba504-4bb5-4682-809f-de8307510c3a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.190300 Jun 20 06:09:57.670852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 345/722] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:57 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:58.653556 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:58.654196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:58.660119 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:58.660567 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:58.661358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:58.661785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:58.688784 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:58.689410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:58.698031 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:58.698534 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:58.699302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:58.699736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:58.846958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:58.854642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0fbfc279-d359-464f-a041-dc7e7d193e60 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.205060 Jun 20 06:09:58.855209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 378/723] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:58 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:58.868738 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:58.876459 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:58.878095 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:09:58.879244 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2076507e-6ef8-47ba-ab48-476de111d34d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.194364 Jun 20 06:09:58.879796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 346/724] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:58 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:09:59.872357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:59.872967 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:59.879128 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:59.879573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:59.880335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:59.880958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:59.898039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:59.898643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:09:59.908376 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:59.909083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:59.910243 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:59.910901 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:00.065213 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:00.072622 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-94315274-7768-4089-9c80-a6d2217e9444 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.205052 Jun 20 06:10:00.073418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 379/725] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:09:59 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:00.091343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:00.099234 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:00.100722 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:00.101907 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f0280ec4-5326-4f9a-9f70-d0aa8add3bec tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.207723 Jun 20 06:10:00.102982 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 347/726] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:09:59 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:01.090035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:01.090576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:01.096462 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:01.096902 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:01.097700 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:01.098125 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:01.119484 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:01.120079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:01.126416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:01.126861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:01.127613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:01.128044 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:01.280353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:01.287720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f497a7a5-e88e-4374-9b42-509df745926a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.202041 Jun 20 06:10:01.288491 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 380/727] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:01 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:01.306231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:01.314095 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:01.315593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:01.316742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8edac074-23d4-482f-9e2e-f56b6eea834f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.201205 Jun 20 06:10:01.317327 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 348/728] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:01 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:02.304875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:02.306150 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:02.312284 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:02.312742 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:02.313598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:02.313992 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:02.335001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:02.335614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:02.342030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:02.342689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:02.343656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:02.344094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:02.808188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:02.815896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-adfea3ff-af7d-4de0-b119-2de5ed95d492 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.514828 Jun 20 06:10:02.816471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 381/729] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:02 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:02.861328 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:02.869596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:02.871048 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:02.872250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-661a9bc6-efbe-40b3-92ac-0444f45496b7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1743 microversion: 2.20 time: 0.541038 Jun 20 06:10:02.872807 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 349/730] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:02 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1743 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:03.833316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:03.833919 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:03.839929 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:03.840370 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:03.841218 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:03.841766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:03.890266 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:03.890977 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:03.898026 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:03.898656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:03.900771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:03.901428 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:04.013531 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:04.021280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8fbc60d8-1f98-4643-9564-ade86928c538 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.191764 Jun 20 06:10:04.021853 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 382/731] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:03 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:04.061570 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:04.070316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:04.071901 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:04.073189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dfba3c24-027f-4bd4-a4da-9079e10d4bfe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1743 microversion: 2.20 time: 0.186721 Jun 20 06:10:04.073765 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 350/732] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:03 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:05.091923 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:05.092533 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:05.094200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:05.094817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:05.098652 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:05.099111 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:05.099874 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:05.100308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:05.100862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:05.101355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:05.102149 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:05.102591 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:05.301107 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:05.304726 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:05.309717 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:05.311523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:05.312769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-806ec30e-775e-4531-a38b-6f0befccebbe tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.222279 Jun 20 06:10:05.313441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 351/733] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:05 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:10:05.313652 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-77e99fc4-88f9-4b47-a85a-818d104d7576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1743 microversion: 2.20 time: 0.225718 Jun 20 06:10:05.314559 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 383/734] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:05 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1743 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:06.331441 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:06.336467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:06.337825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:06.338086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:06.347270 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.347559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.348079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.348206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.349011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.349399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.349520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.350118 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.564224 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:06.567975 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:06.579795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:06.581376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:06.582538 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e57aae41-7ab5-4eb5-83c2-ece786ecc4f1 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1510 microversion: 2.1 time: 0.255777 Jun 20 06:10:06.582747 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a774916b-c8bf-4051-a20a-7c9547a2c067 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.255158 Jun 20 06:10:06.583132 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 352/735] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:06 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:06.583729 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 384/736] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:06 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:06.604756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:06.605612 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:06.611886 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.612527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.613541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.614134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.774375 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3c42718b-964b-4398-a3d6-9d232e764e59 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "POST /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42/action" status: 202 len: 0 microversion: 2.1 time: 0.178124 Jun 20 06:10:06.775341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 353/737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:10:06 2022] POST /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:10:06.784521 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:06.785423 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:06.794037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.794528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.795646 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:06.796254 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:06.954525 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:06.963052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4024d17a-ed46-4d80-902e-62da05208392 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1518 microversion: 2.1 time: 0.182736 Jun 20 06:10:06.964042 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 385/738] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:06 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:07.602636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:07.603254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:07.610508 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:07.611317 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:07.612180 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:07.612696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:07.758228 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:07.767597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:07.769724 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:07.770900 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8306c42b-1def-4cdc-95b2-1c3d194360b2 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.172302 Jun 20 06:10:07.783707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 354/739] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:07 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:07.857627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-2291ad22-6793-4636-ac2a-ceef6444aa59 req-ef118047-82a0-4bf9-920d-d599e32efbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "name": "network-vif-plugged", "status": "completed", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:07.867240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-2291ad22-6793-4636-ac2a-ceef6444aa59 req-ef118047-82a0-4bf9-920d-d599e32efbf5 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:07.869075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-2291ad22-6793-4636-ac2a-ceef6444aa59 req-ef118047-82a0-4bf9-920d-d599e32efbf5 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:07.881509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-2291ad22-6793-4636-ac2a-ceef6444aa59 req-ef118047-82a0-4bf9-920d-d599e32efbf5 service nova] Creating event network-vif-plugged:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:10:07.887803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-2291ad22-6793-4636-ac2a-ceef6444aa59 req-ef118047-82a0-4bf9-920d-d599e32efbf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034466 Jun 20 06:10:07.889055 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 386/740] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:07.980670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:07.981611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:07.991813 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:07.992321 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:07.993735 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:07.994256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:08.171532 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:08.179913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4337c816-8288-4335-8c22-99225ae02680 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1520 microversion: 2.1 time: 0.203925 Jun 20 06:10:08.191154 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 355/741] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:07 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:08.792275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:08.792989 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:08.799811 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:08.800621 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:08.801565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:08.802154 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:09.044965 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:09.057438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:09.059346 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:09.060710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c9ff4b24-2899-4387-9f9e-e96d59f14e98 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.273222 Jun 20 06:10:09.074772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 387/742] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:08 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:09.198051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:09.199400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:09.206454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:09.207194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:09.208071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:09.208615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:09.421391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:09.433152 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-41a89baf-f966-4591-a45c-d834b84d1c5f tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.239666 Jun 20 06:10:09.434134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 356/743] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:09 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:09.908543 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-3a2663d1-393f-4a8c-8630-63757a141c3e req-8825eb16-9e76-40b9-a6c7-ed38298d3ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "name": "network-vif-unplugged", "status": "completed", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:09.917279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3a2663d1-393f-4a8c-8630-63757a141c3e req-8825eb16-9e76-40b9-a6c7-ed38298d3ab9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:09.917934 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3a2663d1-393f-4a8c-8630-63757a141c3e req-8825eb16-9e76-40b9-a6c7-ed38298d3ab9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:09.929886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-3a2663d1-393f-4a8c-8630-63757a141c3e req-8825eb16-9e76-40b9-a6c7-ed38298d3ab9 service nova] Creating event network-vif-unplugged:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:10:09.934980 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-3a2663d1-393f-4a8c-8630-63757a141c3e req-8825eb16-9e76-40b9-a6c7-ed38298d3ab9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030021 Jun 20 06:10:09.938883 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 388/744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:10.083341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:10.083950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:10.090523 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:10.090973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:10.091741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:10.092164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:10.242516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:10.251433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:10.253184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:10.254679 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ab0f2223-6a60-43cf-a6e1-99d9605d4b4f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.178724 Jun 20 06:10:10.266013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 357/745] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:10 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:10.452305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:10.452958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:10.459609 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:10.460359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:10.461177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:10.461615 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:10.619759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:10.628095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-30aa305c-d895-41af-af9c-06cd115bf70a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.181518 Jun 20 06:10:10.628866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 389/746] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:10 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:11.282604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:11.283372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:11.289975 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:11.290420 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:11.291178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:11.291608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:11.423553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:11.432332 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:11.433866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:11.435035 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f4489edc-60f4-486e-9b31-5d0ef99deb29 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.156653 Jun 20 06:10:11.435596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 358/747] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:11 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:11.651159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:11.652311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:11.658604 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:11.659141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:11.659984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:11.660491 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:11.811242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:11.819124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8cc78880-5c94-4c4a-8389-c98877e66530 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.172419 Jun 20 06:10:11.824530 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 390/748] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:11 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:12.453506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:12.455075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:12.462386 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:12.462914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:12.463771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:12.464277 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:12.607789 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:12.615946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:12.617561 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:12.619033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-eaebdfd6-fe8d-4925-a39f-beb5c313eeb1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.169648 Jun 20 06:10:12.629441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 359/749] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:12 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:12.839533 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:12.840138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:12.848015 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:12.848328 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:12.849004 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:12.849436 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:13.007284 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:13.015243 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-60f34831-4e92-4451-a5e3-ccc314ff706e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.180185 Jun 20 06:10:13.025012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 391/750] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:12 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:13.636850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:13.638314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:13.645447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:13.645980 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:13.646834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:13.647350 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:13.787905 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:13.797020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:13.798530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:13.799729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-19fb8a36-39e4-4fa8-aba8-a2df33ae0829 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.166766 Jun 20 06:10:13.810257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 360/751] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:13 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:14.042801 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:14.043407 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:14.050171 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:14.050887 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:14.052100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:14.052726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:14.205242 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:14.213657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2a4670c1-3d3d-4c64-a5eb-825b48e65e96 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.177484 Jun 20 06:10:14.214228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 392/752] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:14 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:14.817563 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:14.818207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:14.824729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:14.825225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:14.825991 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:14.826436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:14.841098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:14.956685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:14.964470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:14.966005 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:14.967168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bf2d3c62-1064-405c-bc62-8459f47bb02f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1738 microversion: 2.20 time: 0.153625 Jun 20 06:10:14.967729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 361/753] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:14 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:15.230524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:15.231097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:15.237175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:15.237629 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:15.238396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:15.238829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:15.374036 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:15.382308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-37db9787-fc5c-48ec-8ce7-61f65e8a4b48 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.155670 Jun 20 06:10:15.382871 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 393/754] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:15 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:15.985667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:15.986277 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:15.988553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=66 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:15.993881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:15.994331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:15.995093 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:15.995527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:16.124182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:16.131966 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:16.133526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:16.134682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ae5565ff-bec0-47d9-831d-ed92327224e1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1720 microversion: 2.20 time: 0.152920 Jun 20 06:10:16.135244 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 362/755] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:15 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:16.400267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:16.400945 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:16.406906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:16.407350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:16.408106 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:16.408538 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:16.608721 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:16.612252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:16.617398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2bce86a2-b367-4af8-b6d0-9c9a1f99ae13 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.221522 Jun 20 06:10:16.618639 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 394/756] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:16 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:17.153407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:17.154015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:17.160688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:17.161203 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:17.161964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:17.162464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:17.293523 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:17.301308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:17.302813 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:17.303994 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4bdf1e18-b5db-423e-9070-2d1f1893105c tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1720 microversion: 2.20 time: 0.155150 Jun 20 06:10:17.304553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 363/757] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:17 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:17.635596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:17.636205 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:17.642314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:17.643002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:17.643762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:17.644191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:17.775045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:17.782576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2074e3f3-01df-47e3-8298-b3e7a646975a tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.151371 Jun 20 06:10:17.783155 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 395/758] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:17 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:17.969535 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-6f1a21d9-b4a0-4a50-8b53-3f90c084dbb1 req-9f8bab90-990c-4edc-a5a7-edc827fc4626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "name": "network-vif-unplugged", "status": "completed", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:17.980922 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-6f1a21d9-b4a0-4a50-8b53-3f90c084dbb1 req-9f8bab90-990c-4edc-a5a7-edc827fc4626 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:17.981388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-6f1a21d9-b4a0-4a50-8b53-3f90c084dbb1 req-9f8bab90-990c-4edc-a5a7-edc827fc4626 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:17.993208 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-6f1a21d9-b4a0-4a50-8b53-3f90c084dbb1 req-9f8bab90-990c-4edc-a5a7-edc827fc4626 service nova] Creating event network-vif-unplugged:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:10:17.998317 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-6f1a21d9-b4a0-4a50-8b53-3f90c084dbb1 req-9f8bab90-990c-4edc-a5a7-edc827fc4626 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032445 Jun 20 06:10:17.998931 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 364/759] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:18.322643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:18.323281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:18.329356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:18.329851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:18.330623 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:18.331056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:18.460434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:18.468357 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:18.469839 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:18.470996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d6bb68fd-bf1c-4423-bbee-d4977e5a107e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1720 microversion: 2.20 time: 0.152917 Jun 20 06:10:18.471585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 396/760] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:18 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:18.800646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:18.801357 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:18.807432 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:18.807876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:18.808623 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:18.809078 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:18.941965 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:18.950047 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6c58c9c0-0841-4646-b2c4-72b042f04c44 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.154102 Jun 20 06:10:18.950611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 365/761] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:18 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:19.489821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:19.490347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:19.496813 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:19.497290 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:19.498040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:19.498468 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:19.621860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:19.629517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:19.630996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:19.632133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1e30c686-d6d1-4322-88e4-5f3d39087cc1 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1663 microversion: 2.20 time: 0.146330 Jun 20 06:10:19.632675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 397/762] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:19 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:19.650177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5afdb31b-faea-43cc-879c-e5bbeba9c8d1"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:19.651255 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:19.657173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:19.657621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:19.658371 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:19.658797 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:19.911538 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-77da2a4c-f14e-4bbc-98d5-f73a69b316ca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.265615 Jun 20 06:10:19.912562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 366/763] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jun 20 06:10:19 2022] POST /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-volume_attachments => generated 188 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:10:19.973443 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:19.974062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:19.983710 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:19.984123 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:19.985453 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:19.985898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.041899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:20.042409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:20.052258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.052258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.052258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.052258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.137867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:20.146501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-20eb06a5-ac45-4a0c-8ac2-d350da0bb0d5 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.176908 Jun 20 06:10:20.147702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 398/764] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:19 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:20.152434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-5d1c569c-ee46-454b-a563-7409f43ab067 req-ab885d88-295e-4952-8275-b33148b4f09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "name": "network-vif-plugged", "status": "completed", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:20.160504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5d1c569c-ee46-454b-a563-7409f43ab067 req-ab885d88-295e-4952-8275-b33148b4f09c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.161229 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5d1c569c-ee46-454b-a563-7409f43ab067 req-ab885d88-295e-4952-8275-b33148b4f09c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.173092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-5d1c569c-ee46-454b-a563-7409f43ab067 req-ab885d88-295e-4952-8275-b33148b4f09c service nova] Creating event network-vif-plugged:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:10:20.178278 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-5d1c569c-ee46-454b-a563-7409f43ab067 req-ab885d88-295e-4952-8275-b33148b4f09c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029225 Jun 20 06:10:20.179363 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 399/765] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:20.319818 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-318d8be3-f305-4641-8b7a-b1a81db48dca tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-volume_attachments/5afdb31b-faea-43cc-879c-e5bbeba9c8d1" status: 202 len: 0 microversion: 2.20 time: 0.281905 Jun 20 06:10:20.321132 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 367/766] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jun 20 06:10:20 2022] DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-volume_attachments/5afdb31b-faea-43cc-879c-e5bbeba9c8d1 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:10:20.378723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:20.379409 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:20.386134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.386582 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.387336 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.387804 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.466774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-246c8927-a62e-4e5c-aca8-dab169b60503 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "POST /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/action" status: 202 len: 0 microversion: 2.20 time: 0.092136 Jun 20 06:10:20.467243 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 400/767] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 20 06:10:20 2022] POST /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:10:20.475230 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:20.475836 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:20.482263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.482942 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.483473 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:20.483936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:20.640816 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:20.649469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:20.651009 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:20.652183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3f74f5d7-771d-4561-927e-f7a060e8c576 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1671 microversion: 2.20 time: 0.180835 Jun 20 06:10:20.652733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 368/768] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:20 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:21.165899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:21.166516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:21.172762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.173502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.174259 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.174687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.306667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:21.314273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d32ec870-eaf1-4349-8bda-2cf761532ac6 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1576 microversion: 2.1 time: 0.152236 Jun 20 06:10:21.314844 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 401/769] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:21 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:21.671396 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:21.671940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:21.678431 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.678885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.680291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.680738 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.805560 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:21.813469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:21.815012 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:21.816174 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ba6b4414-da0b-46b9-925d-75d96a9a2c07 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.149047 Jun 20 06:10:21.816734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 369/770] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:21 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:22.331687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:22.332252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:22.338894 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:22.339345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:22.340100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:22.340534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:22.471307 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:22.479127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d5ae4201-d540-4483-a9ee-1155a8981036 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1563 microversion: 2.1 time: 0.151440 Jun 20 06:10:22.479687 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 402/771] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:22 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:22.834410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:22.835001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:22.841402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:22.841850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:22.842596 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:22.843026 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.041810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:23.050066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:23.051592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:23.052879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-49446c7c-1210-473b-9462-f5171ff06c8f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.222359 Jun 20 06:10:23.053559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 370/772] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:22 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:23.073524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:23.074013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:23.080064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:23.080515 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.081308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:23.081919 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.105484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cba8e434-1336-489e-ad38-1b84697dc8ce tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/ips" status: 200 len: 147 microversion: 2.1 time: 0.036446 Jun 20 06:10:23.106065 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 403/773] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:10:23 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:24.071821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:24.072546 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:24.079324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:24.079772 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:24.080576 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:24.081033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:24.215322 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:24.223560 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:24.225114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:24.226302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7f018f2b-260d-418b-a303-f1f5d2b7638d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.159265 Jun 20 06:10:24.227130 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 371/774] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:24 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:24.433812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5806fced-8211-4f81-9efa-b134af88da34"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:24.434941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:24.441522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:24.442244 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:24.443338 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:24.443788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:25.244910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:25.246977 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:25.254168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:25.254727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:25.255498 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:25.255942 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:25.391584 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:25.400584 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:25.402280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:25.403485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3ee54109-e346-426e-9a61-55a6d67a0de7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.163289 Jun 20 06:10:25.404071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 372/775] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:25 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:26.421407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:26.422046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:26.428681 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:26.429173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:26.430581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:26.431017 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:26.449760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:26.573638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:26.582027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:26.583518 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:26.584720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e7200a56-7843-4d60-a889-509bc7bf122d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.167337 Jun 20 06:10:26.585538 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 373/776] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:26 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:27.604505 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:27.605276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:27.612350 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:27.612815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:27.613645 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:27.614296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:27.754217 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:27.762877 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:27.764482 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:27.765786 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ce0a3f88-9ec3-43bb-8ec8-757ed71d266d tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.165785 Jun 20 06:10:27.766427 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 374/777] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:27 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:28.791254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:28.792051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:28.798015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:28.798631 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:28.799468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:28.799866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:28.955259 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:28.965429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:28.966936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:28.968102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-69f92b31-af7c-4800-ac93-2f7028bc31a5 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.186352 Jun 20 06:10:28.968861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 375/778] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:28 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:29.987559 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:29.988364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:29.995512 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:29.995962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:29.996743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:29.997216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:30.156549 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:30.165198 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:30.166950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:30.168124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b1ecd662-f60e-4943-b19d-fd5b34fba419 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.185291 Jun 20 06:10:30.169036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 376/779] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:29 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:31.187527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:31.188314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:31.194375 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:31.194846 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:31.195618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:31.196045 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:31.329821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:31.338546 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:31.340071 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:31.341254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a781b85e-e24a-4fe3-a606-ad7ac9690e73 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.157573 Jun 20 06:10:31.341814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 377/780] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:31 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:31.910000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0fc41195-4185-4e6c-a5ab-5e72d2b23041 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.480520 Jun 20 06:10:31.910579 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 404/781] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:10:24 2022] POST /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments => generated 194 bytes in 7482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:32.359375 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:32.359935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:32.367378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:32.367840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:32.368624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:32.369091 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:32.499241 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:32.507051 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:32.508544 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:32.509737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7ab0307d-cb7a-4ff7-918e-07aa412a10a4 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.154486 Jun 20 06:10:32.510296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 378/782] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:32 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:33.528899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:33.529625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:33.531558 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=62 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:33.537278 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:33.537739 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:33.539062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:33.539826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:33.666659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:33.674499 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:33.676009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:33.677204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-42fe1975-21ec-4fff-be54-ab7879198826 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.152997 Jun 20 06:10:33.677761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 405/783] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:33 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:34.695814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:34.696443 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:34.702440 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:34.702883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:34.703636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:34.704067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:34.832009 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:34.839717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:34.841234 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:34.842393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f435e1f7-f5f4-438d-94fb-f27bf2d83ba6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.151202 Jun 20 06:10:34.842948 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 379/784] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:34 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:35.859603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:35.860214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:35.866803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:35.867256 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:35.868021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:35.868459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:35.995886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:36.003743 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:36.005274 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:36.006432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a3e8cca2-79ad-41f9-a564-e2b6a78f0498 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.150789 Jun 20 06:10:36.006988 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 406/785] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:35 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:37.025590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:37.026189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:37.032647 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:37.033102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:37.033858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:37.034290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:37.165033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:37.172903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:37.174457 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:37.175627 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-761aca17-5b14-4095-b741-db1f94576baa tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.154520 Jun 20 06:10:37.176187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 380/786] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:37 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:38.067474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-3c3620b3-12ce-4130-941b-15f6a981f2ec req-44984cd5-5cd7-4758-8e5a-f1b3d3d407a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "name": "network-vif-plugged", "status": "completed", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:38.076460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3c3620b3-12ce-4130-941b-15f6a981f2ec req-44984cd5-5cd7-4758-8e5a-f1b3d3d407a9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:38.076898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3c3620b3-12ce-4130-941b-15f6a981f2ec req-44984cd5-5cd7-4758-8e5a-f1b3d3d407a9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:38.088516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-3c3620b3-12ce-4130-941b-15f6a981f2ec req-44984cd5-5cd7-4758-8e5a-f1b3d3d407a9 service nova] Creating event network-vif-plugged:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:10:38.093227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-3c3620b3-12ce-4130-941b-15f6a981f2ec req-44984cd5-5cd7-4758-8e5a-f1b3d3d407a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029351 Jun 20 06:10:38.093813 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 407/787] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:38.194454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:38.195023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:38.202865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:38.203324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:38.204101 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:38.204540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:38.633388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:38.641077 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:38.642569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:38.643975 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a87b4079-5106-4568-a8b6-c091df7177f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.453832 Jun 20 06:10:38.644532 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 381/788] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:38 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:39.663418 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:39.664058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:39.670762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:39.671218 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:39.671969 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:39.672404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:39.797494 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:39.805875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:39.807379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:39.808526 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e9d03a87-3221-4573-9c6e-bfd9a3e68262 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.149967 Jun 20 06:10:39.809115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 408/789] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:39 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:40.445433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:40.446944 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:40.453500 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:40.453949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:40.454704 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:40.455133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:40.484436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5afd6ce3-21dd-4b10-ac31-8d42607a7718 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042810 Jun 20 06:10:40.485192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 382/790] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:10:40 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:40.494806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:40.495303 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:40.501416 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:40.501814 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:40.502578 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:40.503018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:40.532654 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-33d97eaf-eb4f-472d-b8c2-4ea9ed302c33 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/5806fced-8211-4f81-9efa-b134af88da34" status: 200 len: 194 microversion: 2.1 time: 0.041767 Jun 20 06:10:40.533301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 409/791] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jun 20 06:10:40 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/5806fced-8211-4f81-9efa-b134af88da34 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:40.826467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:40.827082 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:40.833675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:40.834124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:40.834889 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:40.835325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:40.975736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:40.983707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:40.985421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:40.986660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3620cc37-ba85-4867-bde4-a25ded53b437 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1729 microversion: 2.20 time: 0.163982 Jun 20 06:10:40.987219 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 383/792] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:40 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:41.864693 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb0286a0-6903-4c0f-bad9-6a48ad0f9c11"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:41.865855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:41.872447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:41.872904 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:41.873703 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:41.874142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:41.942989 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:42.005868 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:42.006493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:42.013620 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:42.014070 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:42.014821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:42.015258 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:42.147532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-670e0325-71fc-4849-9023-08823f46fc84 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "POST /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286629 Jun 20 06:10:42.152790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 410/793] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:10:41 2022] POST /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:42.158436 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:42.159020 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:42.165405 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:42.165864 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:42.166635 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:42.167075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:42.172098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:42.183162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:42.184871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:42.186173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-27760e81-c6b5-4049-80b8-33e61f9f0742 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1716 microversion: 2.20 time: 0.184260 Jun 20 06:10:42.187059 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 384/794] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:10:42 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1716 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:10:42.191854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c5e33362-26c7-423e-8304-669bc15d7bf5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/ips" status: 200 len: 151 microversion: 2.1 time: 0.037621 Jun 20 06:10:42.192744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 411/795] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:10:42 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:43.539174 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b980ccb6-4a7c-4b41-809c-a3f95ce8a315"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:43.540267 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:43.546854 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:43.547310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:43.548072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:43.548515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:43.799243 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7f154dfd-a2b2-464c-b1fe-71eed8a25966 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263920 Jun 20 06:10:43.799849 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 385/796] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:10:43 2022] POST /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:49.655571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:49.656485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:49.662912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:49.663355 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:49.664806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:49.665263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:49.693434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2ad545db-6c7a-46f4-840d-5bf13665b9b2 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041604 Jun 20 06:10:49.693900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 412/797] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:10:49 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:49.840672 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:49.841268 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:49.843125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=48 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:49.848941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:49.849421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:49.850182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:49.850614 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:49.880671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5b8ed7f9-0e31-443d-8fde-9a587d7d04d8 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/5806fced-8211-4f81-9efa-b134af88da34" status: 200 len: 194 microversion: 2.1 time: 0.045495 Jun 20 06:10:49.881453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 386/798] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jun 20 06:10:49 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/5806fced-8211-4f81-9efa-b134af88da34 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:10:49.890934 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:49.891431 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:49.897808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:49.898745 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:49.899545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:49.899984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:49.980262 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lazy-loading 'services' on Instance uuid 13906ca2-b15e-4c2e-8079-b5a30b4edf86 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:10:50.059667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c77b9c6c-8371-4cfe-ad26-4a3e643b952b tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/5806fced-8211-4f81-9efa-b134af88da34" status: 202 len: 0 microversion: 2.1 time: 0.172478 Jun 20 06:10:50.060583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 413/799] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:10:49 2022] DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/5806fced-8211-4f81-9efa-b134af88da34 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:10:56.534629 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-45c233e0-c772-4b96-916e-37dded79118d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: .version_select at 0x7f9d37fd78b0>, body: {"keypair": {"name": "tempest-keypair-1763656888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuiA/yxELvaN6CtJBfyNl0RnD59zgRE6RzviYzbxP+mBcWRnqPrn/nUba5nI2CHMfeCUcOxxraaACeJI+lE8xAyUvy8phB55WD0ngVYJlKGMg2Jo6MA+yfktsjFuMXhjg=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:56.548740 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-45c233e0-c772-4b96-916e-37dded79118d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:10:56.552527 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-45c233e0-c772-4b96-916e-37dded79118d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:10:56.577006 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-45c233e0-c772-4b96-916e-37dded79118d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046016 Jun 20 06:10:56.577664 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 387/800] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:10:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:57.495984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:57.496677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:57.503075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:57.503530 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:57.504297 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:57.504735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:57.532781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a2a2cb55-7697-4ae7-98ab-48a7614a2387 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/fb0286a0-6903-4c0f-bad9-6a48ad0f9c11" status: 200 len: 194 microversion: 2.1 time: 0.042409 Jun 20 06:10:57.533398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 414/801] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jun 20 06:10:57 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/fb0286a0-6903-4c0f-bad9-6a48ad0f9c11 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:10:57.544082 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:57.544625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:57.550608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:57.551171 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:57.551931 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:57.552364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:57.556851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:57.635482 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lazy-loading 'services' on Instance uuid 13906ca2-b15e-4c2e-8079-b5a30b4edf86 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:10:57.706927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-813cf4b0-9bbb-4fd9-a88f-ffcb75254468 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/fb0286a0-6903-4c0f-bad9-6a48ad0f9c11" status: 202 len: 0 microversion: 2.1 time: 0.167041 Jun 20 06:10:57.707576 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 388/802] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:10:57 2022] DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments/fb0286a0-6903-4c0f-bad9-6a48ad0f9c11 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:10:57.829661 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-403633395", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dfe8112-b1c3-4379-ace8-53ea74527bdb"}], "security_groups": [{"name": "tempest-securitygroup--1954278890"}], "key_name": "tempest-keypair-1763656888", "user_data": "}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:10:57.931126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] validate_networks() for [('5dfe8112-b1c3-4379-ace8-53ea74527bdb', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:10:58.295570 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:10:58.295992 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:10:58.296459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:10:58.296867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:10:58.297306 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:10:58.306768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:58.307212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:58.308002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:58.308430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:58.324779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:10:58.328672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:10:58.339151 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:10:58.341406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:10:58.390503 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9599a611-79cc-4a47-b8c6-f125273841d2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565049 Jun 20 06:10:58.391260 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 415/803] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:10:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:10:58.402554 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b9668332-fe63-4318-9ad1-c5fa0282f07b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:58.403323 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b9668332-fe63-4318-9ad1-c5fa0282f07b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:58.461293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b9668332-fe63-4318-9ad1-c5fa0282f07b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:58.472490 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b9668332-fe63-4318-9ad1-c5fa0282f07b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1241 microversion: 2.1 time: 0.074633 Jun 20 06:10:58.473093 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 389/804] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:58 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:58.875843 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:58.876820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:58.883122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:58.883616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:58.884318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:58.884759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:58.917375 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0e9cb32b-afaa-4764-bfa6-3277bf404593 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045892 Jun 20 06:10:58.917927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 416/805] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:10:58 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:10:59.024860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:59.025990 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:59.032796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.033268 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.034033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.034470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.063391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ef523b89-18ae-4ccf-8905-57e2b75d7792 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042736 Jun 20 06:10:59.063623 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 390/806] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:10:59 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:10:59.121312 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:59.121868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:59.128478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.128998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.129855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.130342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.156292 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:10:59.230694 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-429f76ad-d8f3-4358-b6b0-a2ef3c7369fa tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 204 len: 0 microversion: 2.1 time: 0.114049 Jun 20 06:10:59.231273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 417/807] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:10:59 2022] DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:10:59.239214 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:59.239819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:59.245658 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.246098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.246850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.247280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.377872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:59.386353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-98989082-75e0-42bf-a42a-0306ff1b3920 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1675 microversion: 2.1 time: 0.150876 Jun 20 06:10:59.387039 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 391/808] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:59 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:10:59.492471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:10:59.493209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:10:59.499294 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.499744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.500497 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:59.500931 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:59.561904 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:10:59.569297 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-867f057d-e079-40ad-8150-c1717825f5b5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1301 microversion: 2.1 time: 0.081564 Jun 20 06:10:59.570466 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 418/809] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:10:59 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:00.403608 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:00.404156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:00.410574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:00.411015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:00.411755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:00.412184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:00.543079 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:00.550682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fd745711-e11e-459a-8f62-a35f82fa894a tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1675 microversion: 2.1 time: 0.150948 Jun 20 06:11:00.551292 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 392/810] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:00 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:00.586712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:00.587348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:00.593578 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:00.594032 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:00.594817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:00.595260 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:00.655141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:00.662179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d6f4ed8f-add2-4334-9ecd-88f9256c9e99 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1301 microversion: 2.1 time: 0.079264 Jun 20 06:11:00.662736 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 419/811] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:00 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1301 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:01.567698 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:01.568331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:01.574675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:01.575120 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:01.575880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:01.576312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:01.681014 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:01.681590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:01.688407 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:01.688865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:01.689665 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:01.690097 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:01.794622 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:01.802741 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ccb5bbc5-a830-4175-af54-4e2995626a11 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1299 microversion: 2.1 time: 0.126842 Jun 20 06:11:01.804412 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 420/812] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:01 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:01.820082 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:01.828061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-57b35109-62dd-4523-b28b-c2b0d1fd42f3 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1675 microversion: 2.1 time: 0.264189 Jun 20 06:11:01.828884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 393/813] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:01 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:02.510541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-a90b374c-fd2a-4b4b-8b95-950ace8137c4 req-0e0c2a3c-e5c7-412a-8327-26bdbcb7da74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13906ca2-b15e-4c2e-8079-b5a30b4edf86", "name": "network-vif-deleted", "tag": "eeec6141-d200-4a28-9270-09f919342290"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:02.526842 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-a90b374c-fd2a-4b4b-8b95-950ace8137c4 req-0e0c2a3c-e5c7-412a-8327-26bdbcb7da74 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:02.527352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-a90b374c-fd2a-4b4b-8b95-950ace8137c4 req-0e0c2a3c-e5c7-412a-8327-26bdbcb7da74 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:02.544950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-a90b374c-fd2a-4b4b-8b95-950ace8137c4 req-0e0c2a3c-e5c7-412a-8327-26bdbcb7da74 service nova] Creating event network-vif-deleted:eeec6141-d200-4a28-9270-09f919342290 for instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 on hv-cinder-83699 Jun 20 06:11:02.550744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-a90b374c-fd2a-4b4b-8b95-950ace8137c4 req-0e0c2a3c-e5c7-412a-8327-26bdbcb7da74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044058 Jun 20 06:11:02.552471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 421/814] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:02.820889 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:02.822759 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:02.831592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:02.832672 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:02.834579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:02.836249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:02.847176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:02.848742 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:02.856662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:02.857350 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:02.858323 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:02.858921 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:02.900511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:02.901589 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:02.902434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lazy-loading 'fault' on Instance uuid 13906ca2-b15e-4c2e-8079-b5a30b4edf86 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:11:02.976088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fcbdaedda84e74b7b2c78415e71d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9ee28e3a9543b3b9f9df141b4845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:02.985136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0790e854-8d29-4bed-8fdc-6a57d41561cc tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 200 len: 1328 microversion: 2.1 time: 0.143299 Jun 20 06:11:02.986950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 422/815] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:02 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 1328 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:02.993422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-cf75a6d7-8cfa-49b0-91fe-4e5724e5e399 req-77e5da37-6ecc-409e-934b-ac4979e17925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541914cc-a90e-4ca3-b086-fd3860a01da0", "tag": "2fd98d02-b368-437d-b2b5-5830e3086cdd"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:03.003963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-cf75a6d7-8cfa-49b0-91fe-4e5724e5e399 req-77e5da37-6ecc-409e-934b-ac4979e17925 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:03.004579 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-cf75a6d7-8cfa-49b0-91fe-4e5724e5e399 req-77e5da37-6ecc-409e-934b-ac4979e17925 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:03.021062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-cf75a6d7-8cfa-49b0-91fe-4e5724e5e399 req-77e5da37-6ecc-409e-934b-ac4979e17925 service nova] Creating event network-changed:2fd98d02-b368-437d-b2b5-5830e3086cdd for instance 541914cc-a90e-4ca3-b086-fd3860a01da0 on hv-cinder-83699 Jun 20 06:11:03.033522 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-cf75a6d7-8cfa-49b0-91fe-4e5724e5e399 req-77e5da37-6ecc-409e-934b-ac4979e17925 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038170 Jun 20 06:11:03.034248 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 423/816] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:03.118659 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:03.127600 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9ebfe9b0-ea65-4279-9860-003d51197b45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.310380 Jun 20 06:11:03.128656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 394/817] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:02 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:04.003987 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:04.004682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:04.006605 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.012938 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:04.013421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:04.014191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:04.014633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:04.029603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] HTTP exception thrown: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Request method failure captured: Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 HTTP/1.1 Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3IbVySGcDCvd_Mh9sodh3E9ZeUAm9-gHUlRB_u5arclNxf45hK7Z2Azfw1qAxn9fb6KOQdP3TyWwTH-RYui9N8EWt0AZCpR33S3sSv7CXFnSKKE7ZF3HRIQiXelZW0lO3h3nLlMRXoBKWjPEq3xOY5i2S7CmOeTQSINJ240ihsBiI Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:04.031207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb9ee28e3a9543b3b9f9df141b4845f8", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: a8fcbdaedda84e74b7b2c78415e71d9c Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:04.032817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '13906ca2-b15e-4c2e-8079-b5a30b4edf86'} Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:04.033779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:04.035280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:04.036644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Returning 404 to user: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:04.036644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-751cc60b-60af-4b67-a95a-11b53ba9f3fb tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 404 len: 111 microversion: 2.1 time: 0.033219 Jun 20 06:11:04.036644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 424/818] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:03 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:04.042174 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e128adeb-5e12-4ba6-acd0-bd9fd0203c51 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '.version_select at 0x7f9d37f87af0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:04.058822 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e128adeb-5e12-4ba6-acd0-bd9fd0203c51 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109244542" status: 202 len: 0 microversion: 2.1 time: 0.021112 Jun 20 06:11:04.059397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 395/819] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 20 06:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109244542 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:04.145254 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:04.145873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:04.152347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:04.152800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:04.153603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:04.154040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:04.303681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:04.311880 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1eedf350-b2fb-489b-b336-0494a5e26fc3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.170806 Jun 20 06:11:04.312447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 425/820] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:04 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:05.328872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:05.329514 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:05.336677 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:05.337164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:05.337927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:05.338362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:05.464892 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:05.472286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-807de5a3-9b54-4d44-9357-094e99fce365 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.147703 Jun 20 06:11:05.472847 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 396/821] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:05 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:06.489215 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:06.489858 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:06.496931 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:06.497421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:06.498194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:06.498632 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:06.516314 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:06.625377 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:06.633343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-79c71473-d50d-4843-951d-0ffa2045deb6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.148192 Jun 20 06:11:06.633906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 426/822] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:06 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:06.932775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:06.933347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:06.939901 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:06.940353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:06.941141 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:06.941580 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:06.955382 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] HTTP exception thrown: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Request method failure captured: Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 HTTP/1.1 Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3IbVySGcDCvd_Mh9sodh3E9ZeUAm9-gHUlRB_u5arclNxf45hK7Z2Azfw1qAxn9fb6KOQdP3TyWwTH-RYui9N8EWt0AZCpR33S3sSv7CXFnSKKE7ZF3HRIQiXelZW0lO3h3nLlMRXoBKWjPEq3xOY5i2S7CmOeTQSINJ240ihsBiI Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:06.957076 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb9ee28e3a9543b3b9f9df141b4845f8", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: a8fcbdaedda84e74b7b2c78415e71d9c Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.958610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '13906ca2-b15e-4c2e-8079-b5a30b4edf86'} Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:06.960393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.961826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.963182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Returning 404 to user: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:06.963182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-64db2da9-8886-4071-b0f6-8dcc5cb71aa0 tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 404 len: 111 microversion: 2.1 time: 0.030345 Jun 20 06:11:06.963182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 397/823] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:11:06 2022] DELETE /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:06.966912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:06.967516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: 13906ca2-b15e-4c2e-8079-b5a30b4edf86] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:06.973520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:06.973967 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:06.974714 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:06.975147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:06.987831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] HTTP exception thrown: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Request method failure captured: Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 HTTP/1.1 Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3IbVySGcDCvd_Mh9sodh3E9ZeUAm9-gHUlRB_u5arclNxf45hK7Z2Azfw1qAxn9fb6KOQdP3TyWwTH-RYui9N8EWt0AZCpR33S3sSv7CXFnSKKE7ZF3HRIQiXelZW0lO3h3nLlMRXoBKWjPEq3xOY5i2S7CmOeTQSINJ240ihsBiI Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:06.989354 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb9ee28e3a9543b3b9f9df141b4845f8", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: a8fcbdaedda84e74b7b2c78415e71d9c Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.990906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '13906ca2-b15e-4c2e-8079-b5a30b4edf86'} Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:06.992281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. Jun 20 06:11:06.993702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:06.994956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Returning 404 to user: Instance 13906ca2-b15e-4c2e-8079-b5a30b4edf86 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:06.994956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6ca8e4ec-55a2-4a9a-9783-9b62214ca61d tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86" status: 404 len: 111 microversion: 2.1 time: 0.027575 Jun 20 06:11:06.994956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 427/824] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:06 2022] GET /compute/v2.1/servers/13906ca2-b15e-4c2e-8079-b5a30b4edf86 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:07.650892 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:07.651441 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:07.657464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:07.657913 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:07.658670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:07.659105 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:07.783342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:07.791754 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-728feade-7624-42b0-a7f2-8ed71441dae1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.145333 Jun 20 06:11:07.792389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 398/825] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:07 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:08.122702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:08.123282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:08.129847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.130367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.131208 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.131707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.145956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] HTTP exception thrown: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Request method failure captured: Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd HTTP/1.1 Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3IbVySGcDCvd_Mh9sodh3E9ZeUAm9-gHUlRB_u5arclNxf45hK7Z2Azfw1qAxn9fb6KOQdP3TyWwTH-RYui9N8EWt0AZCpR33S3sSv7CXFnSKKE7ZF3HRIQiXelZW0lO3h3nLlMRXoBKWjPEq3xOY5i2S7CmOeTQSINJ240ihsBiI Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:08.147504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb9ee28e3a9543b3b9f9df141b4845f8", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: a8fcbdaedda84e74b7b2c78415e71d9c Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.149479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'aaa707d4-de8c-4e79-8ea0-053c93eb13cd'} Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:08.150203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.151394 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.152690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Returning 404 to user: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:08.152690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9efeddb-4bca-4f1e-b74f-fc16e81299af tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 404 len: 111 microversion: 2.1 time: 0.030835 Jun 20 06:11:08.152690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 428/826] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:11:08 2022] DELETE /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:08.158153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:08.158752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] [instance: aaa707d4-de8c-4e79-8ea0-053c93eb13cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:08.165286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.165830 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.166592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.167024 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.180117 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] HTTP exception thrown: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Request method failure captured: Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd HTTP/1.1 Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3IbVySGcDCvd_Mh9sodh3E9ZeUAm9-gHUlRB_u5arclNxf45hK7Z2Azfw1qAxn9fb6KOQdP3TyWwTH-RYui9N8EWt0AZCpR33S3sSv7CXFnSKKE7ZF3HRIQiXelZW0lO3h3nLlMRXoBKWjPEq3xOY5i2S7CmOeTQSINJ240ihsBiI Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:08.181662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb9ee28e3a9543b3b9f9df141b4845f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb9ee28e3a9543b3b9f9df141b4845f8", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: bb9ee28e3a9543b3b9f9df141b4845f8 Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1190563319 Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: a8fcbdaedda84e74b7b2c78415e71d9c Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-1190563319-project Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.183167 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'aaa707d4-de8c-4e79-8ea0-053c93eb13cd'} Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:08.187565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. Jun 20 06:11:08.189537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:08.190841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] Returning 404 to user: Instance aaa707d4-de8c-4e79-8ea0-053c93eb13cd could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:08.190841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7af1b859-99f8-4fee-b339-06dab8b9472e tempest-AttachVolumeTestJSON-1190563319 tempest-AttachVolumeTestJSON-1190563319-project] 10.222.0.20 "GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd" status: 404 len: 111 microversion: 2.1 time: 0.028738 Jun 20 06:11:08.190841 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 399/827] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:08 2022] GET /compute/v2.1/servers/aaa707d4-de8c-4e79-8ea0-053c93eb13cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:08.215080 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-90c46d16-ec1e-4845-b4a8-a0f77367f7e3 req-576e4559-7bd5-4cd5-bb2d-dc1d35eac7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541914cc-a90e-4ca3-b086-fd3860a01da0", "name": "network-vif-plugged", "status": "completed", "tag": "2fd98d02-b368-437d-b2b5-5830e3086cdd"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:08.223951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-90c46d16-ec1e-4845-b4a8-a0f77367f7e3 req-576e4559-7bd5-4cd5-bb2d-dc1d35eac7a1 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.224524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-90c46d16-ec1e-4845-b4a8-a0f77367f7e3 req-576e4559-7bd5-4cd5-bb2d-dc1d35eac7a1 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.239008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-90c46d16-ec1e-4845-b4a8-a0f77367f7e3 req-576e4559-7bd5-4cd5-bb2d-dc1d35eac7a1 service nova] Creating event network-vif-plugged:2fd98d02-b368-437d-b2b5-5830e3086cdd for instance 541914cc-a90e-4ca3-b086-fd3860a01da0 on hv-cinder-83699 Jun 20 06:11:08.244817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-90c46d16-ec1e-4845-b4a8-a0f77367f7e3 req-576e4559-7bd5-4cd5-bb2d-dc1d35eac7a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Jun 20 06:11:08.245524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 429/828] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:08.809200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:08.809828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:08.811861 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:08.817667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.818125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.818907 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:08.819352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:08.956198 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:08.964438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-092e6e43-bfbe-4567-bbd7-b515ded91b3e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.159196 Jun 20 06:11:08.965030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 400/829] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:08 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:09.978545 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:09.979927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:09.985631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:09.986566 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:09.994903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:09.995610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:09.996513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:09.997136 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:10.139053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:10.146837 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c76e2bee-4464-4ee6-b7a5-9723dae5ea82 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1367 microversion: 2.1 time: 0.169242 Jun 20 06:11:10.147481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 430/830] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:09 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:11.164879 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:11.165635 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:11.188821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:11.189372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:11.190170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:11.190624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:11.354128 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:11.361920 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bae078c1-ed7f-4968-a611-fa0946a10a50 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1557 microversion: 2.1 time: 0.202042 Jun 20 06:11:11.362611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 401/831] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:11 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:11.379642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:11.381076 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:11.389186 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:11.389765 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:11.390768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:11.391311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:11.478638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f06f0c2c-be52-4369-b4a9-fb95e927daa4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103215 Jun 20 06:11:11.479534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 431/832] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:11:11 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:12.678186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-49bdbf40-524d-4e2a-b6e6-efbc07114bef req-737de6f5-a81f-42c3-aec8-1fbceade8e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541914cc-a90e-4ca3-b086-fd3860a01da0", "tag": "2fd98d02-b368-437d-b2b5-5830e3086cdd"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:12.688489 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-49bdbf40-524d-4e2a-b6e6-efbc07114bef req-737de6f5-a81f-42c3-aec8-1fbceade8e92 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:12.688940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-49bdbf40-524d-4e2a-b6e6-efbc07114bef req-737de6f5-a81f-42c3-aec8-1fbceade8e92 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:12.701950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-49bdbf40-524d-4e2a-b6e6-efbc07114bef req-737de6f5-a81f-42c3-aec8-1fbceade8e92 service nova] Creating event network-changed:2fd98d02-b368-437d-b2b5-5830e3086cdd for instance 541914cc-a90e-4ca3-b086-fd3860a01da0 on hv-cinder-83699 Jun 20 06:11:12.707415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-49bdbf40-524d-4e2a-b6e6-efbc07114bef req-737de6f5-a81f-42c3-aec8-1fbceade8e92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033088 Jun 20 06:11:12.708095 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 402/833] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:21.622546 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=15 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:21.623294 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=18 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:21.627190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.628092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:21.635312 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.635758 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.636516 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.636950 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.665557 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-320dea75-fdb0-4214-8be2-2e167c676e6a tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044376 Jun 20 06:11:21.666096 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 432/834] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:21.723804 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.724392 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:21.726355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:21.731810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.732263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.733054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.733495 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.758794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:11:21.835307 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a91e9f81-e8e8-49f1-a129-bc8e250d7038 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 204 len: 0 microversion: 2.20 time: 0.115252 Jun 20 06:11:21.835947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 403/835] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 20 06:11:21 2022] DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:11:21.844311 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.844928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:21.851698 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.852332 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.853243 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.853689 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.985062 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:21.993463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:21.994963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:21.996119 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-211a3454-1d88-426e-9c89-265c4d19f27e tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.155751 Jun 20 06:11:21.996680 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 433/836] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:11:23.014453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:23.015148 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:23.022905 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.023357 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.024200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.024663 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.158251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:23.166139 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:23.167647 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:23.168817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d7c12c97-49cb-47c4-bc61-8d5f4b334ea0 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1722 microversion: 2.20 time: 0.158840 Jun 20 06:11:23.169409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 404/837] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:23 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:24.186225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:24.186831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:24.192951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.193416 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.194765 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.195195 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.272991 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:24.280843 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:24.282386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '715da00088754d0e8c6ecfa5a2c9b50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce606b9c1e514773a7201b9e83a8af69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:24.283548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8e0b26dc-3856-4027-8fb5-4f5059321fd6 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 200 len: 1655 microversion: 2.20 time: 0.101185 Jun 20 06:11:24.284103 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 434/838] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:24 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:24.384858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-606b0d9e-367f-43de-86c3-c478674cf516 req-c91253d6-8d99-405a-ac0d-49cea3ce56a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3cf00c-e900-44c9-abe3-75093e0f71dd", "name": "network-vif-deleted", "tag": "3027fd60-8c06-4696-83d4-c06074ec9b1b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:24.394047 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-606b0d9e-367f-43de-86c3-c478674cf516 req-c91253d6-8d99-405a-ac0d-49cea3ce56a1 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.394490 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-606b0d9e-367f-43de-86c3-c478674cf516 req-c91253d6-8d99-405a-ac0d-49cea3ce56a1 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.405520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-606b0d9e-367f-43de-86c3-c478674cf516 req-c91253d6-8d99-405a-ac0d-49cea3ce56a1 service nova] Creating event network-vif-deleted:3027fd60-8c06-4696-83d4-c06074ec9b1b for instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd on hv-cinder-83699 Jun 20 06:11:24.410371 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-606b0d9e-367f-43de-86c3-c478674cf516 req-c91253d6-8d99-405a-ac0d-49cea3ce56a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 Jun 20 06:11:24.411046 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 405/839] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:25.302075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:25.302779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:25.308859 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.309697 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.310482 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.310989 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.325273 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] HTTP exception thrown: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Request method failure captured: Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd HTTP/1.1 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3OXoMuasBvbh5GA6WMM3T1i6iJr0L6CWL1zzM3p02yA_rx5cNTSWo5qnHt8WhO-k66SyK7GEt7CjlZ7qCwvWgvP-no-wToAhiSNohBCfnzCYGk7L-qt2s51M9LJvUBJVTA_e_tSwhg9Tn5iIw_7k6QTrsZ9mgwuDX6igKcOs3OeBg Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:25.326937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce606b9c1e514773a7201b9e83a8af69", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 715da00088754d0e8c6ecfa5a2c9b50c Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:25.328691 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '3b3cf00c-e900-44c9-abe3-75093e0f71dd'} Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:25.329638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:25.331124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.332463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Returning 404 to user: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:25.332463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-65841bf1-4f8b-4fc9-ac77-f98786d961c7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 404 len: 111 microversion: 2.20 time: 0.030563 Jun 20 06:11:25.332463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 435/840] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:25 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:11:25.338417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1a2e7844-ef07-4bd9-87c8-072d1ed4d905 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '.version_select at 0x7f9d37f87280>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:25.356487 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1a2e7844-ef07-4bd9-87c8-072d1ed4d905 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458256055" status: 204 len: 0 microversion: 2.20 time: 0.022738 Jun 20 06:11:25.359330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 406/841] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Jun 20 06:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458256055 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:11:27.108335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:27.108907 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:27.115401 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:27.116343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.117131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:27.117567 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.130565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] HTTP exception thrown: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Request method failure captured: Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd HTTP/1.1 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3OXoMuasBvbh5GA6WMM3T1i6iJr0L6CWL1zzM3p02yA_rx5cNTSWo5qnHt8WhO-k66SyK7GEt7CjlZ7qCwvWgvP-no-wToAhiSNohBCfnzCYGk7L-qt2s51M9LJvUBJVTA_e_tSwhg9Tn5iIw_7k6QTrsZ9mgwuDX6igKcOs3OeBg Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:27.133085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce606b9c1e514773a7201b9e83a8af69", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 715da00088754d0e8c6ecfa5a2c9b50c Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.134738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '3b3cf00c-e900-44c9-abe3-75093e0f71dd'} Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:27.135649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.137043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.138459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Returning 404 to user: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:27.138459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7bbaf4e2-14ba-4e24-af12-2683bbdc7ed7 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 404 len: 111 microversion: 2.20 time: 0.030189 Jun 20 06:11:27.138459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 436/842] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 20 06:11:27 2022] DELETE /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:11:27.144499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:27.145590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: 3b3cf00c-e900-44c9-abe3-75093e0f71dd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:27.152235 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:27.152865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.153674 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:27.154280 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.168947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] HTTP exception thrown: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Request method failure captured: Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd HTTP/1.1 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3OXoMuasBvbh5GA6WMM3T1i6iJr0L6CWL1zzM3p02yA_rx5cNTSWo5qnHt8WhO-k66SyK7GEt7CjlZ7qCwvWgvP-no-wToAhiSNohBCfnzCYGk7L-qt2s51M9LJvUBJVTA_e_tSwhg9Tn5iIw_7k6QTrsZ9mgwuDX6igKcOs3OeBg Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:27.170839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce606b9c1e514773a7201b9e83a8af69", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 715da00088754d0e8c6ecfa5a2c9b50c Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.172347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '3b3cf00c-e900-44c9-abe3-75093e0f71dd'} Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:27.173200 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. Jun 20 06:11:27.174444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:27.175511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Returning 404 to user: Instance 3b3cf00c-e900-44c9-abe3-75093e0f71dd could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:27.175511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-488f266b-6ce7-4828-b6c7-9276c4ab22f9 tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd" status: 404 len: 111 microversion: 2.20 time: 0.032980 Jun 20 06:11:27.176250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 407/843] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:27 2022] GET /compute/v2.1/servers/3b3cf00c-e900-44c9-abe3-75093e0f71dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:11:28.311610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:28.312149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:28.318511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.319000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.319759 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.320188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.333576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] HTTP exception thrown: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Request method failure captured: Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 HTTP/1.1 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA3OXoMuasBvbh5GA6WMM3T1i6iJr0L6CWL1zzM3p02yA_rx5cNTSWo5qnHt8WhO-k66SyK7GEt7CjlZ7qCwvWgvP-no-wToAhiSNohBCfnzCYGk7L-qt2s51M9LJvUBJVTA_e_tSwhg9Tn5iIw_7k6QTrsZ9mgwuDX6igKcOs3OeBg Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:28.335252 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce606b9c1e514773a7201b9e83a8af69", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 715da00088754d0e8c6ecfa5a2c9b50c Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.337564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'e69f0c75-8247-4de3-9021-72428abdf335'} Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:28.338474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.340131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.342056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Returning 404 to user: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:28.342056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fe82d1f6-6035-4b6d-ab01-50ce2725eebe tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 404 len: 111 microversion: 2.20 time: 0.028818 Jun 20 06:11:28.342056 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 437/844] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 20 06:11:28 2022] DELETE /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:11:28.346952 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:28.347638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] [instance: e69f0c75-8247-4de3-9021-72428abdf335] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:28.354820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.355448 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.356284 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.356790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.364144 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:28.373857 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] HTTP exception thrown: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Request method failure captured: Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 HTTP/1.1 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA3OXoMuasBvbh5GA6WMM3T1i6iJr0L6CWL1zzM3p02yA_rx5cNTSWo5qnHt8WhO-k66SyK7GEt7CjlZ7qCwvWgvP-no-wToAhiSNohBCfnzCYGk7L-qt2s51M9LJvUBJVTA_e_tSwhg9Tn5iIw_7k6QTrsZ9mgwuDX6igKcOs3OeBg Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:28.375471 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce606b9c1e514773a7201b9e83a8af69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce606b9c1e514773a7201b9e83a8af69", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ce606b9c1e514773a7201b9e83a8af69 Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1631719947 Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 715da00088754d0e8c6ecfa5a2c9b50c Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1631719947-project Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.377176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'e69f0c75-8247-4de3-9021-72428abdf335'} Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:28.378098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. Jun 20 06:11:28.379880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:28.381572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] Returning 404 to user: Instance e69f0c75-8247-4de3-9021-72428abdf335 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:28.381572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f829a1c2-541d-41ed-a41d-79ab2057228f tempest-AttachVolumeShelveTestJSON-1631719947 tempest-AttachVolumeShelveTestJSON-1631719947-project] 10.222.0.20 "GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335" status: 404 len: 111 microversion: 2.20 time: 0.035568 Jun 20 06:11:28.382769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 408/845] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:28 2022] GET /compute/v2.1/servers/e69f0c75-8247-4de3-9021-72428abdf335 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:11:32.844903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fbdd384d-09d5-49dc-9b5d-66bc9599ea35 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Action: 'create', calling method: .version_select at 0x7f9d48a7c790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1028372114"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:33.134325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fbdd384d-09d5-49dc-9b5d-66bc9599ea35 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.398226 Jun 20 06:11:33.134962 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 438/846] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Jun 20 06:11:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 06:11:33.146440 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0648c8f1-eb49-4114-88e5-58e39f6b943a tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d37fe1d30>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:33.195417 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0648c8f1-eb49-4114-88e5-58e39f6b943a tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 200 len: 345 microversion: 2.1 time: 0.053332 Jun 20 06:11:33.196295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 409/847] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:33 2022] GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:34.207936 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6109773c-c792-4e76-82fb-4de6ae20abfe tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d442b9a60>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:34.256155 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6109773c-c792-4e76-82fb-4de6ae20abfe tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 200 len: 346 microversion: 2.1 time: 0.052491 Jun 20 06:11:34.256712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 439/848] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:34 2022] GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:34.268400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-357ed436-214f-461c-9bb0-e7c37a9098a1 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Action: 'create', calling method: .version_select at 0x7f9d44026ee0>, body: {"snapshot": {"volume_id": "d26451d9-37ba-4b8a-9030-1e9bc786188c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-312496187"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:34.423453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-357ed436-214f-461c-9bb0-e7c37a9098a1 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.159449 Jun 20 06:11:34.429194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 410/849] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Jun 20 06:11:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:34.434985 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-029af3b5-c1e3-4cb0-aadb-21e6f7d00c75 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d441f7a60>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:34.466567 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-029af3b5-c1e3-4cb0-aadb-21e6f7d00c75 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 200 len: 286 microversion: 2.1 time: 0.035544 Jun 20 06:11:34.467170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 440/850] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:34 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:34.477236 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9451d35e-48ac-47df-a496-d8051ada1969 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d37fc9160>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:34.506044 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9451d35e-48ac-47df-a496-d8051ada1969 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033065 Jun 20 06:11:34.506607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 411/851] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jun 20 06:11:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:34.516903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2af0f0d4-0fee-465a-90cb-21ec741e0dfb tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d4420b8b0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:34.545913 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2af0f0d4-0fee-465a-90cb-21ec741e0dfb tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 200 len: 286 microversion: 2.1 time: 0.033153 Jun 20 06:11:34.546462 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 441/852] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:34 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:35.558208 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fbe7b220-8c5d-441a-aece-6b32763b9911 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d44026280>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:35.589045 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fbe7b220-8c5d-441a-aece-6b32763b9911 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 200 len: 286 microversion: 2.1 time: 0.035711 Jun 20 06:11:35.589615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 412/853] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:35 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:36.600126 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-58979003-0b19-47b9-8c91-88159e66d923 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d48a7ca60>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:36.629464 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-58979003-0b19-47b9-8c91-88159e66d923 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 200 len: 286 microversion: 2.1 time: 0.033544 Jun 20 06:11:36.633954 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 442/854] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:36 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:37.642086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5d9f62bc-b89c-4322-aaa9-b5e55286119d tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d37f87c10>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:37.674023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5d9f62bc-b89c-4322-aaa9-b5e55286119d tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 200 len: 287 microversion: 2.1 time: 0.036188 Jun 20 06:11:37.674671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 413/855] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:37 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:37.685830 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9eea88e-05fe-43b3-bc49-ff964c4751c4 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d4417e1f0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:37.743486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9eea88e-05fe-43b3-bc49-ff964c4751c4 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 202 len: 0 microversion: 2.1 time: 0.062019 Jun 20 06:11:37.744082 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 443/856] 10.222.0.20 () {58 vars in 1253 bytes} [Mon Jun 20 06:11:37 2022] DELETE /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:37.752021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-90f7972a-cc12-4f49-8a01-125bad912092 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d37f878b0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:37.782324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-90f7972a-cc12-4f49-8a01-125bad912092 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 200 len: 286 microversion: 2.1 time: 0.033954 Jun 20 06:11:37.783310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 414/857] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:37 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:38.790335 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=12 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.791132 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=24 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.796116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-44e2e78c-98f2-4511-b5fe-ae4abdd12e9c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d48a591f0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:38.827608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-44e2e78c-98f2-4511-b5fe-ae4abdd12e9c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] HTTP exception thrown: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-44e2e78c-98f2-4511-b5fe-ae4abdd12e9c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Request method failure captured: Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 HTTP/1.1 Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA-UaLG_xuswMqeKq3iK5LHs5i06We_43uELRwjNV6X7x8rOXHYTAavj01PnBU5ay3On6U0OgMjwub5YAIuN5yZdMOataFCNim4GiDfp10BUX63bsnLAV_r8XP7fspEVy_fbxkK34GKBhZFqH9qYdxKswgOUsMVCnpPx1m2VH4dFEeY Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:38.830356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8947fc692b134d3aa1d874b3dc40213d", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 7449bbbb9a88482cb8974a29988d1e8b Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'df7c12c4-cfa5-454a-b62e-72a88bb0cbb9'} Jun 20 06:11:38.831847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. (HTTP 404) (Request-ID: req-0ccb8fb6-c755-4619-9554-0d7bb57c6256) Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.832761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:38.834070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 06:11:38.835782 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-44e2e78c-98f2-4511-b5fe-ae4abdd12e9c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Returning 404 to user: Snapshot df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:38.839998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-44e2e78c-98f2-4511-b5fe-ae4abdd12e9c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9" status: 404 len: 111 microversion: 2.1 time: 0.042308 Jun 20 06:11:38.841986 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 444/858] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:38 2022] GET /compute/v2.1/os-snapshots/df7c12c4-cfa5-454a-b62e-72a88bb0cbb9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:38.843023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ee1d2ccf-8b9f-412e-b4c7-7f8782fd720f tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d44026160>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:38.853712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.927666 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ee1d2ccf-8b9f-412e-b4c7-7f8782fd720f tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 202 len: 0 microversion: 2.1 time: 0.090079 Jun 20 06:11:38.928835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 415/859] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:38 2022] DELETE /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:38.937585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e8f7a8f2-13be-48f3-b31f-40840241583a tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d48a4a9d0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:38.986464 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e8f7a8f2-13be-48f3-b31f-40840241583a tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 200 len: 345 microversion: 2.1 time: 0.052603 Jun 20 06:11:38.987053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 445/860] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:38 2022] GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:39.999524 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-075822a8-b770-4b4f-9446-c95b0dc16208 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d440443a0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:40.027901 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-075822a8-b770-4b4f-9446-c95b0dc16208 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] HTTP exception thrown: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-075822a8-b770-4b4f-9446-c95b0dc16208 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Request method failure captured: Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c HTTP/1.1 Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA-UaLG_xuswMqeKq3iK5LHs5i06We_43uELRwjNV6X7x8rOXHYTAavj01PnBU5ay3On6U0OgMjwub5YAIuN5yZdMOataFCNim4GiDfp10BUX63bsnLAV_r8XP7fspEVy_fbxkK34GKBhZFqH9qYdxKswgOUsMVCnpPx1m2VH4dFEeY Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:40.030194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8947fc692b134d3aa1d874b3dc40213d", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 7449bbbb9a88482cb8974a29988d1e8b Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'd26451d9-37ba-4b8a-9030-1e9bc786188c'} Jun 20 06:11:40.031860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. (HTTP 404) (Request-ID: req-930cada9-44ec-467c-81eb-c2128f6418b7) Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.033075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:40.034568 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:40.036615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-075822a8-b770-4b4f-9446-c95b0dc16208 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Returning 404 to user: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-075822a8-b770-4b4f-9446-c95b0dc16208 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 404 len: 109 microversion: 2.1 time: 0.036526 Jun 20 06:11:40.038819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 416/861] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:39 2022] GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:40.046564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-68e73d31-19ff-4cad-8f5d-0220b9dddf6c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d48a59f70>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:40.075085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-68e73d31-19ff-4cad-8f5d-0220b9dddf6c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] HTTP exception thrown: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-68e73d31-19ff-4cad-8f5d-0220b9dddf6c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Request method failure captured: Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c HTTP/1.1 Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA-UaLG_xuswMqeKq3iK5LHs5i06We_43uELRwjNV6X7x8rOXHYTAavj01PnBU5ay3On6U0OgMjwub5YAIuN5yZdMOataFCNim4GiDfp10BUX63bsnLAV_r8XP7fspEVy_fbxkK34GKBhZFqH9qYdxKswgOUsMVCnpPx1m2VH4dFEeY Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:40.077088 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8947fc692b134d3aa1d874b3dc40213d", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 7449bbbb9a88482cb8974a29988d1e8b Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'd26451d9-37ba-4b8a-9030-1e9bc786188c'} Jun 20 06:11:40.078655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. (HTTP 404) (Request-ID: req-a827b645-afb3-410e-be16-fb9b074893d6) Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.080415 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:11:40.081968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:11:40.083402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-68e73d31-19ff-4cad-8f5d-0220b9dddf6c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Returning 404 to user: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-68e73d31-19ff-4cad-8f5d-0220b9dddf6c tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 404 len: 109 microversion: 2.1 time: 0.036300 Jun 20 06:11:40.085325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 446/862] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:40 2022] DELETE /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:40.088014 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8cfc97f0-55c2-41d1-8352-3dc8cd4290d3 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Calling method '.version_select at 0x7f9d37fe1af0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:40.114351 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-8cfc97f0-55c2-41d1-8352-3dc8cd4290d3 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] HTTP exception thrown: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8cfc97f0-55c2-41d1-8352-3dc8cd4290d3 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Request method failure captured: Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c HTTP/1.1 Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA-UaLG_xuswMqeKq3iK5LHs5i06We_43uELRwjNV6X7x8rOXHYTAavj01PnBU5ay3On6U0OgMjwub5YAIuN5yZdMOataFCNim4GiDfp10BUX63bsnLAV_r8XP7fspEVy_fbxkK34GKBhZFqH9qYdxKswgOUsMVCnpPx1m2VH4dFEeY Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:40.116829 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8947fc692b134d3aa1d874b3dc40213d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8947fc692b134d3aa1d874b3dc40213d", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 8947fc692b134d3aa1d874b3dc40213d Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1721221127 Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 7449bbbb9a88482cb8974a29988d1e8b Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1721221127-project Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'd26451d9-37ba-4b8a-9030-1e9bc786188c'} Jun 20 06:11:40.118407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. (HTTP 404) (Request-ID: req-1da5b185-16e3-4d2d-b8f3-11848f5209bb) Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.119359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:40.120697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:40.122354 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8cfc97f0-55c2-41d1-8352-3dc8cd4290d3 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] Returning 404 to user: Volume d26451d9-37ba-4b8a-9030-1e9bc786188c could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8cfc97f0-55c2-41d1-8352-3dc8cd4290d3 tempest-VolumesSnapshotsTestJSON-1721221127 tempest-VolumesSnapshotsTestJSON-1721221127-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c" status: 404 len: 109 microversion: 2.1 time: 0.034567 Jun 20 06:11:40.123792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 417/863] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:40 2022] GET /compute/v2.1/os-volumes/d26451d9-37ba-4b8a-9030-1e9bc786188c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:45.752528 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.753937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.764890 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.765852 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.766050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.766513 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.767002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.772112 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-40ac3732-d213-48eb-812b-65d4f120610d req-8c9ddc1f-596c-4bd2-a646-c19648d7a974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:45.781385 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-40ac3732-d213-48eb-812b-65d4f120610d req-8c9ddc1f-596c-4bd2-a646-c19648d7a974 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.782109 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-40ac3732-d213-48eb-812b-65d4f120610d req-8c9ddc1f-596c-4bd2-a646-c19648d7a974 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.793685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-40ac3732-d213-48eb-812b-65d4f120610d req-8c9ddc1f-596c-4bd2-a646-c19648d7a974 service nova] Creating event network-changed:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:11:45.795653 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:11:45.799367 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-40ac3732-d213-48eb-812b-65d4f120610d req-8c9ddc1f-596c-4bd2-a646-c19648d7a974 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Jun 20 06:11:45.800158 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 418/864] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:45.900654 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4ad4958e-7209-4686-8e34-fd30cf398c0e tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 204 len: 0 microversion: 2.1 time: 0.151187 Jun 20 06:11:45.901367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 447/865] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:11:45 2022] DELETE /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:11:45.910712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.911509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.917828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.918279 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.919042 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.919509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.067748 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.076239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7936cbc0-f595-41d6-923b-5109099bbb6c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.170307 Jun 20 06:11:46.077590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 419/866] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:47.094703 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.095346 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.101875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.102371 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.103179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.103660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.314681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.323474 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-586559d0-bd3e-4c72-b7c7-4b078e90a924 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.233005 Jun 20 06:11:47.324051 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 448/867] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.340610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.341244 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.347880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.348377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.349173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.349618 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.477286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.484684 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-afa703c2-9435-43d5-8aec-d755b8f72781 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.147910 Jun 20 06:11:48.485284 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 420/868] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:49.501872 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.502484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.508956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.509439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.510209 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.510644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.642469 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.649921 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-39212cc0-8be6-40ef-891c-e56ebd16a4b2 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.151927 Jun 20 06:11:49.650493 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 449/869] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:50.419860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.420355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.430272 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.433476 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.436155 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.436711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.488339 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:11:50.626166 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e02c10d2-2c7f-481e-90bf-d2839a321a52 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 204 len: 0 microversion: 2.1 time: 0.210228 Jun 20 06:11:50.628201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 421/870] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:11:50 2022] DELETE /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:11:50.637293 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.638047 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.653207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.653672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.654452 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.656364 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.670125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.670858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.677199 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.678259 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.679096 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.679562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.875018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.885683 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fc4420ee-e3e7-48e0-b66b-3459f53f5b8a tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1578 microversion: 2.1 time: 0.252445 Jun 20 06:11:50.887643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 450/871] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:50.909626 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.918129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b7d3ef7e-1bbf-440a-8068-d0539885f6cc tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1569 microversion: 2.1 time: 0.253764 Jun 20 06:11:50.918719 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 422/872] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:50.968571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-d2d8b219-d15a-4b86-827f-7292cade9025 req-e504653f-9362-4248-a933-97d09564a71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0826f2-7616-4a05-a32b-799ae83cda42", "name": "network-vif-deleted", "tag": "d4c36e20-9172-4931-b7e3-341265fbc820"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:50.979796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-d2d8b219-d15a-4b86-827f-7292cade9025 req-e504653f-9362-4248-a933-97d09564a71c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.980342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-d2d8b219-d15a-4b86-827f-7292cade9025 req-e504653f-9362-4248-a933-97d09564a71c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.992432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-d2d8b219-d15a-4b86-827f-7292cade9025 req-e504653f-9362-4248-a933-97d09564a71c service nova] Creating event network-vif-deleted:d4c36e20-9172-4931-b7e3-341265fbc820 for instance 3b0826f2-7616-4a05-a32b-799ae83cda42 on hv-cinder-83699 Jun 20 06:11:50.997458 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-d2d8b219-d15a-4b86-827f-7292cade9025 req-e504653f-9362-4248-a933-97d09564a71c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032855 Jun 20 06:11:50.998524 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 451/873] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:51.905256 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.905873 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.912472 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.912929 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.913735 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.914153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.937505 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.938410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.952813 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.953388 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.954217 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.954751 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.041205 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99817225e5d420880fe221b74c22518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2faf73842cb4faabb12f920b54bbcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.051112 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-52cef7b5-1e0f-4f8c-bc0b-932283c7e44c tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 200 len: 1382 microversion: 2.1 time: 0.119008 Jun 20 06:11:52.052000 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 452/874] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 1382 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:52.088897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.096617 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b2a71394-eac5-4c36-9bf3-6e998d39cf44 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1578 microversion: 2.1 time: 0.196293 Jun 20 06:11:52.097213 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 423/875] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:53.069309 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.069928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] [instance: 3b0826f2-7616-4a05-a32b-799ae83cda42] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.076509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.077023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.077792 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.078253 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.092489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] HTTP exception thrown: Instance 3b0826f2-7616-4a05-a32b-799ae83cda42 could not be found. Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Request method failure captured: Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 HTTP/1.1 Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA5XG3H6X7Csioz4gab_EZQ-Dh5Ea_YwWQctMTaYTiSWqStGYsYop_u2iu35vY0_GAm7fpTcuuV3zFiTYbL2R_rqNFGt_fnFSSs2vB1twQVxAUHVbeHt-kArpOftXIll_hdjy5Y2HPyyiSZEJ-_AmG9BYLQjIyQyMtJq7b8fGveyYiU Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: c2faf73842cb4faabb12f920b54bbcb7 Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-TestShelveInstance-709860117 Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:11:53.094170 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2faf73842cb4faabb12f920b54bbcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2faf73842cb4faabb12f920b54bbcb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2faf73842cb4faabb12f920b54bbcb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2faf73842cb4faabb12f920b54bbcb7", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-TestShelveInstance-709860117 Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: c2faf73842cb4faabb12f920b54bbcb7 Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-TestShelveInstance-709860117 Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-TestShelveInstance-709860117-project Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: a99817225e5d420880fe221b74c22518 Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-TestShelveInstance-709860117-project Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 3b0826f2-7616-4a05-a32b-799ae83cda42 could not be found. Jun 20 06:11:53.096061 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '3b0826f2-7616-4a05-a32b-799ae83cda42'} Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0826f2-7616-4a05-a32b-799ae83cda42 could not be found. Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:53.101406 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0826f2-7616-4a05-a32b-799ae83cda42 could not be found. Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0826f2-7616-4a05-a32b-799ae83cda42 could not be found. Jun 20 06:11:53.104485 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:11:53.106507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Returning 404 to user: Instance 3b0826f2-7616-4a05-a32b-799ae83cda42 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:53.106507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6741778a-7ea8-41b5-b963-399829b3e052 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42" status: 404 len: 111 microversion: 2.1 time: 0.030480 Jun 20 06:11:53.106507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 453/876] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/3b0826f2-7616-4a05-a32b-799ae83cda42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:53.115503 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.116170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.123917 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.124400 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.125475 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.126347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.232579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.243135 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c08d4e6b-712e-44ff-86c8-ecc43fb65793 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1510 microversion: 2.1 time: 0.131861 Jun 20 06:11:53.243771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 424/877] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1510 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:53.306607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-db52593d-29c9-4106-9912-44e4676f97c8 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] Calling method '.version_select at 0x7f9d48a4aaf0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.350141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-db52593d-29c9-4106-9912-44e4676f97c8 tempest-TestShelveInstance-709860117 tempest-TestShelveInstance-709860117-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-178333891" status: 202 len: 0 microversion: 2.1 time: 0.047372 Jun 20 06:11:53.351018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 454/878] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-178333891 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:53.555156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-d9704ab6-5739-48f8-bc1b-0d58d4085c55 req-d65eae5c-bd3f-4e80-b911-ed0b71c3b91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39cb3098-0dae-49b3-b980-6c5aec56db4b", "name": "network-vif-deleted", "tag": "bdb57701-d4f1-44b0-8c33-bfa74e2488df"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:53.567655 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d9704ab6-5739-48f8-bc1b-0d58d4085c55 req-d65eae5c-bd3f-4e80-b911-ed0b71c3b91c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.568997 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d9704ab6-5739-48f8-bc1b-0d58d4085c55 req-d65eae5c-bd3f-4e80-b911-ed0b71c3b91c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.581735 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-d9704ab6-5739-48f8-bc1b-0d58d4085c55 req-d65eae5c-bd3f-4e80-b911-ed0b71c3b91c service nova] Creating event network-vif-deleted:bdb57701-d4f1-44b0-8c33-bfa74e2488df for instance 39cb3098-0dae-49b3-b980-6c5aec56db4b on hv-cinder-83699 Jun 20 06:11:53.588403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-d9704ab6-5739-48f8-bc1b-0d58d4085c55 req-d65eae5c-bd3f-4e80-b911-ed0b71c3b91c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037905 Jun 20 06:11:53.593183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 425/879] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:54.261226 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.262659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.270548 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.271362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.273141 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.273794 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.311811 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.312517 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.313289 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lazy-loading 'fault' on Instance uuid 39cb3098-0dae-49b3-b980-6c5aec56db4b {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:11:54.368735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.378835 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0920f9ef-1b26-426d-b4c5-44c884c09c3e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 200 len: 1230 microversion: 2.1 time: 0.121751 Jun 20 06:11:54.379490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 455/880] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:55.397453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.398212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.410355 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.412405 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.413844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.414653 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.432102 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] HTTP exception thrown: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Request method failure captured: Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b HTTP/1.1 Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA75ezrxRIDRsoGrApHBF-nPRbFhhcGt4EA8A6Gc2bKayDzc0Eq_E59pvg7GQxg5Yujrlbgijzlmnt8p36Ts4sdl1ujtnzT_3Yytib8sN_1n8x2goyYKBdEGK4f0gRWh8hVO4o_IAHxcwgrrEsJOl1jiOVrdtRwDAr_fv37q2ZQ8INA Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:55.434691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_888311b555bb436ca9bc99aed66458d5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestVolumeBootPattern-857602549 Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 8a4b39d3a27c4077b88cd0802a240b53 Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:11:55.436378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '39cb3098-0dae-49b3-b980-6c5aec56db4b'} Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:55.437468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:11:55.439218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:55.440602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Returning 404 to user: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:55.440602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1afffa36-f43c-446e-a430-418ce56f4ce8 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 404 len: 111 microversion: 2.1 time: 0.044999 Jun 20 06:11:55.440602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 426/881] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:11:55.599974 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1301193439", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-724460958", "security_groups": [{"name": "tempest-secgroup-smoke-1378745963"}], "block_device_mapping_v2": [{"uuid": "5a07724e-4d95-4f98-b21c-28b42e627108", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82f005d7-3296-4650-9513-388af91b26c4"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:55.889082 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] validate_networks() for [('82f005d7-3296-4650-9513-388af91b26c4', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:56.252499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.253326 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.261569 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.262520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.263796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.264491 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.294927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fa2fc4de-2e30-4350-9bde-9a9f0d34a87d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/ips" status: 200 len: 149 microversion: 2.1 time: 0.047270 Jun 20 06:11:56.296151 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 427/882] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:56.309101 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b980ccb6-4a7c-4b41-809c-a3f95ce8a315"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:56.310760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.320164 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.321014 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.322470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.322995 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.437736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Invalid volume: volume b980ccb6-4a7c-4b41-809c-a3f95ce8a315 is already attached to instances: 66d4998a-6c49-45ad-9768-8df93ecacb8d Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/os-volume_attachments HTTP/1.1 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 74 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:11:56.440574 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {"volumeAttachment": {"volumeId": "b980ccb6-4a7c-4b41-809c-a3f95ce8a315"}} Jun 20 06:11:56.441992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Invalid volume: volume b980ccb6-4a7c-4b41-809c-a3f95ce8a315 is already attached to instances: 66d4998a-6c49-45ad-9768-8df93ecacb8d Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'server_id': '541914cc-a90e-4ca3-b086-fd3860a01da0', 'body': {'volumeAttachment': {'volumeId': 'b980ccb6-4a7c-4b41-809c-a3f95ce8a315'}}} Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b980ccb6-4a7c-4b41-809c-a3f95ce8a315 is already attached to instances: 66d4998a-6c49-45ad-9768-8df93ecacb8d Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:56.443366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b980ccb6-4a7c-4b41-809c-a3f95ce8a315 is already attached to instances: 66d4998a-6c49-45ad-9768-8df93ecacb8d Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:56.444583 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:56.446094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:56.446094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:56.446094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:56.446094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b980ccb6-4a7c-4b41-809c-a3f95ce8a315 is already attached to instances: 66d4998a-6c49-45ad-9768-8df93ecacb8d Jun 20 06:11:56.446094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:11:56.447401 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 400 to user: Invalid volume: volume b980ccb6-4a7c-4b41-809c-a3f95ce8a315 is already attached to instances: 66d4998a-6c49-45ad-9768-8df93ecacb8d {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:56.450327 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d74fa427-b838-4ad1-a9d1-fa69cfb9dfee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147162 Jun 20 06:11:56.451787 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 428/883] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:11:56 2022] POST /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:11:56.460907 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.461675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.470858 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.471315 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.472077 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.472514 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.508954 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:11:56.611597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-56198ec5-4506-4d87-8c40-281618f76a4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 204 len: 0 microversion: 2.1 time: 0.154487 Jun 20 06:11:56.612687 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 429/884] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:11:56 2022] DELETE /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:11:56.621948 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.622705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.628630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.629124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.629899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.630914 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.257014 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:57.257538 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:57.257942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:57.260624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:57.261099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:57.276207 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.277624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.283882 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.285713 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.331361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for project 888311b555bb436ca9bc99aed66458d5. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:57.336277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for user 8a4b39d3a27c4077b88cd0802a240b53 and project 888311b555bb436ca9bc99aed66458d5. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:57.408086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.420726 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cb90029c-db8b-48f1-989e-5fcdc4d72dc7 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1681 microversion: 2.1 time: 0.802841 Jun 20 06:11:57.421295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 430/885] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1681 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.422866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:57.425433 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a07724e-4d95-4f98-b21c-28b42e627108',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:57.580437 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3db5e73a-c1a5-414b-80de-757df14243bd tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.984423 Jun 20 06:11:57.581280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 456/886] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:57.592389 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2ecf89bf-20d7-47b6-94c7-c5b3308eba04 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.593755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2ecf89bf-20d7-47b6-94c7-c5b3308eba04 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.722447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2ecf89bf-20d7-47b6-94c7-c5b3308eba04 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.731642 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2ecf89bf-20d7-47b6-94c7-c5b3308eba04 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1094 microversion: 2.1 time: 0.143365 Jun 20 06:11:57.741407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 431/887] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1094 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:58.444095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.444721 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.452153 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.453127 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.454322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.455086 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.748497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.749720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.770022 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.771871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.773872 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.774586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.871270 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.880887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5b9281a2-7d2f-49ca-9e53-198cc8deb34b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1192 microversion: 2.1 time: 0.135664 Jun 20 06:11:58.882094 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 432/888] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1192 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.894063 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.904230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-16274200-81d8-4bbd-b1f9-e9bd524864e1 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1681 microversion: 2.1 time: 0.465317 Jun 20 06:11:58.913663 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 457/889] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1681 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:59.898661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.900632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.921449 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.922666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.931574 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.935332 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.936634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.938024 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.939526 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.942018 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.943438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.945108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.095997 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.110799 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f759e648-ffa0-4f3a-95f8-9238bbab04b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1210 microversion: 2.1 time: 0.214252 Jun 20 06:12:00.121314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 433/890] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1210 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:00.126789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.136593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-7665918b-6a40-491b-b04c-118ef8433044 req-e9a4cca4-46c7-45a7-a9c7-e942a0469d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541914cc-a90e-4ca3-b086-fd3860a01da0", "name": "network-vif-deleted", "tag": "2fd98d02-b368-437d-b2b5-5830e3086cdd"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:00.137784 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7791d770-bda2-4575-9308-19cb0ad41739 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 200 len: 1613 microversion: 2.1 time: 0.219938 Jun 20 06:12:00.141348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 458/891] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 1613 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:00.169541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-7665918b-6a40-491b-b04c-118ef8433044 req-e9a4cca4-46c7-45a7-a9c7-e942a0469d7c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.171469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-7665918b-6a40-491b-b04c-118ef8433044 req-e9a4cca4-46c7-45a7-a9c7-e942a0469d7c service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.196823 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-7665918b-6a40-491b-b04c-118ef8433044 req-e9a4cca4-46c7-45a7-a9c7-e942a0469d7c service nova] Creating event network-vif-deleted:2fd98d02-b368-437d-b2b5-5830e3086cdd for instance 541914cc-a90e-4ca3-b086-fd3860a01da0 on hv-cinder-83699 Jun 20 06:12:00.207602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-7665918b-6a40-491b-b04c-118ef8433044 req-e9a4cca4-46c7-45a7-a9c7-e942a0469d7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079299 Jun 20 06:12:00.209369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 434/892] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:01.128817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.129469 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.136014 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.136541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.137259 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.137699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.159410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.160127 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.179056 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.179591 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.180453 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.180969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.187227 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:01.198921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 HTTP/1.1 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:12:01.200696 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:12:01.202372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '541914cc-a90e-4ca3-b086-fd3860a01da0'} Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:01.203257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:12:01.205050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:12:01.206469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:01.206469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-46fc4726-6186-4f6a-aba8-5600f4ebd121 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 404 len: 111 microversion: 2.1 time: 0.047035 Jun 20 06:12:01.206469 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 435/893] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:01.211749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6a520fd3-2ff3-47ab-8529-a0e3b72f22da tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '.version_select at 0x7f9d44068ee0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.232817 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.242179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f087a37f-02b4-4db3-ad21-a88eb75560ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1198 microversion: 2.1 time: 0.117152 Jun 20 06:12:01.249383 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 459/894] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:01.256226 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6a520fd3-2ff3-47ab-8529-a0e3b72f22da tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763656888" status: 202 len: 0 microversion: 2.1 time: 0.048713 Jun 20 06:12:01.256821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 436/895] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 20 06:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763656888 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:12:02.261853 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.263055 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.272081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.272755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.274093 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.275045 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.302171 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.302671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.313317 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.314657 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.315769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.316338 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.414736 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lazy-loading 'services' on Instance uuid 66d4998a-6c49-45ad-9768-8df93ecacb8d {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:12:02.441337 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.453971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2e655a8f-400d-4394-8a9f-0fc0b69cb5fe tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.195857 Jun 20 06:12:02.465429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 460/896] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:02.515542 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-589a0657-04be-4f4a-8d2f-8084eb063d45 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments/b980ccb6-4a7c-4b41-809c-a3f95ce8a315" status: 202 len: 0 microversion: 2.1 time: 0.217252 Jun 20 06:12:02.516856 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 437/897] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:12:02 2022] DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments/b980ccb6-4a7c-4b41-809c-a3f95ce8a315 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:12:02.526951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.529802 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.542877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.543764 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.544755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.545459 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.578322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-58cab0ee-5ef9-4315-9648-3db603a73f9b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057022 Jun 20 06:12:02.578898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 461/898] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:03.314087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-5bd9ef9e-c685-44ab-b88b-bb8d3cbda605 req-bf655d8a-b631-4a89-83ae-83998c3d0ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a6dca5-89dd-405d-8015-62e8cbcf08ac", "tag": "abd12247-83f5-467d-9fbd-501eb1f1c0e7"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:03.323660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-5bd9ef9e-c685-44ab-b88b-bb8d3cbda605 req-bf655d8a-b631-4a89-83ae-83998c3d0ee2 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.324796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-5bd9ef9e-c685-44ab-b88b-bb8d3cbda605 req-bf655d8a-b631-4a89-83ae-83998c3d0ee2 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.338446 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-5bd9ef9e-c685-44ab-b88b-bb8d3cbda605 req-bf655d8a-b631-4a89-83ae-83998c3d0ee2 service nova] Creating event network-changed:abd12247-83f5-467d-9fbd-501eb1f1c0e7 for instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac on hv-cinder-83699 Jun 20 06:12:03.343322 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-5bd9ef9e-c685-44ab-b88b-bb8d3cbda605 req-bf655d8a-b631-4a89-83ae-83998c3d0ee2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 Jun 20 06:12:03.343921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 438/899] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:03.471939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.472594 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.480124 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.481184 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.482182 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.482611 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.590564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.591635 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.597973 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.598546 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.600192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.600638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.633267 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:03.633784 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6359e0dc-851e-4159-9a0a-26c8193fa6fe tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Jun 20 06:12:03.637959 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 439/900] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:03.641255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-62d63f76-45a3-427c-9e68-18f85e06b7f7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.173249 Jun 20 06:12:03.641812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 462/901] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:04.646624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.647110 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.657734 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.658953 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.666367 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.669883 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.670621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.671647 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.672309 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.673028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.676554 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.677787 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.724633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-34dde00f-4a14-4a9c-9ab8-fbc66e473088 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082705 Jun 20 06:12:04.725731 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 440/902] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:04.904648 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.913211 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-90c54e9a-a23a-45dd-bec8-1e85e74e08cf tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.259517 Jun 20 06:12:04.925964 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 463/903] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:05.736155 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.737098 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.744186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.744666 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.745499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.745936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.775458 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b4971915-ae3d-47da-b430-2c9ade65d4ab tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043280 Jun 20 06:12:05.776049 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 441/904] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:12:05.840356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.840886 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.847325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.847792 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.849114 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.849735 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.871745 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:05.880800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:12:05.932903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.933572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.941675 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.942163 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.943727 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.944429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.974562 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-204aec00-728c-4b4b-8b47-fe807a49f902 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 204 len: 0 microversion: 2.1 time: 0.137662 Jun 20 06:12:05.976185 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 464/905] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:12:05 2022] DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:12:05.985333 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.986244 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.993803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.994533 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.995301 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.995736 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.181978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.190415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a48eb00e-820e-4004-955d-d6d5c3d49441 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.261124 Jun 20 06:12:06.191442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 442/906] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:06.195880 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.204265 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a4808455-9089-4f9c-89cb-30e80527792c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1683 microversion: 2.1 time: 0.223263 Jun 20 06:12:06.205191 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 465/907] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:07.207688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.208317 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.215562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.216027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.216835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.218069 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.222956 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.224470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.231152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.231604 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.232376 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.232810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.295583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.349535 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.422138 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.426362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.434539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5b383959-a22a-4824-9c0a-20e7ceff3cb0 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1683 microversion: 2.1 time: 0.215326 Jun 20 06:12:07.434634 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-531b9d0c-8b57-4e52-af27-f2deda0408c4 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.230598 Jun 20 06:12:07.435232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 466/908] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:07.435575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 443/909] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:08.451763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.452463 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.458419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.458925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.459923 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.461377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.462033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.463187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.463853 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.467789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.468245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.469028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.469478 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.578435 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.589907 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-50627bde-3867-4610-bd3f-28806196910b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 200 len: 1616 microversion: 2.1 time: 0.137057 Jun 20 06:12:08.590669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 467/910] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 1616 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:08.703763 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-f3748571-f4f8-43da-a623-46bf940f3342 req-4b19eb3f-b3ca-4786-b693-770db5b0a751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d4998a-6c49-45ad-9768-8df93ecacb8d", "name": "network-vif-deleted", "tag": "b57b3f8b-bd03-4e93-90cf-ffffd34a640a"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:08.706217 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.713156 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f3748571-f4f8-43da-a623-46bf940f3342 req-4b19eb3f-b3ca-4786-b693-770db5b0a751 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.713922 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f3748571-f4f8-43da-a623-46bf940f3342 req-4b19eb3f-b3ca-4786-b693-770db5b0a751 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.729404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-f3748571-f4f8-43da-a623-46bf940f3342 req-4b19eb3f-b3ca-4786-b693-770db5b0a751 service nova] Creating event network-vif-deleted:b57b3f8b-bd03-4e93-90cf-ffffd34a640a for instance 66d4998a-6c49-45ad-9768-8df93ecacb8d on hv-cinder-83699 Jun 20 06:12:08.736098 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-f3748571-f4f8-43da-a623-46bf940f3342 req-4b19eb3f-b3ca-4786-b693-770db5b0a751 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 Jun 20 06:12:08.736483 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-31f32605-183d-476f-8a1b-86513f93384d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.272613 Jun 20 06:12:08.747451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 468/911] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:08.747729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 444/912] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:09.608607 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.609402 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.612140 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:09.620447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.621352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.622454 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.623058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.646404 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d HTTP/1.1 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:12:09.648222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:12:09.649768 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '66d4998a-6c49-45ad-9768-8df93ecacb8d'} Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:09.650585 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:12:09.652534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:09.654699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:09.654699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9bb42373-3364-49d2-9a50-ea87da1dee4e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 404 len: 111 microversion: 2.1 time: 0.045754 Jun 20 06:12:09.654699 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 469/913] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:09.658897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-43b38d43-089d-47a3-b850-0a8dc302420d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '.version_select at 0x7f9d37fd7280>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.669598 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:09.683883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-43b38d43-089d-47a3-b850-0a8dc302420d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954187817" status: 202 len: 0 microversion: 2.1 time: 0.028685 Jun 20 06:12:09.685422 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 445/914] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 20 06:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954187817 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:12:09.753488 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.754110 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.767827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.768287 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.769095 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.769532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.982050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.990009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b3a02c54-8488-4394-860a-39801cc2e8a7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.240942 Jun 20 06:12:09.993065 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 470/915] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:10.468420 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f29ccd73-5c0f-4d20-857d-ef1987b7ed10 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: .version_select at 0x7f9d440c81f0>, body: {"keypair": {"name": "tempest-keypair-802281984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpcyG5Olh2WKfxxMbUaTMiR5XiPYolH+oHnOO6ii9X6Mbeww60vyEmItKwIpe3th+DUUTuIh389BzCs3l5vzQZCwBV8/rJ14E1nANk4kFrmrpdRqgW5QfemsvpvSUxBOw=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:10.482876 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-f29ccd73-5c0f-4d20-857d-ef1987b7ed10 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:12:10.486825 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-f29ccd73-5c0f-4d20-857d-ef1987b7ed10 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:12:10.509288 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f29ccd73-5c0f-4d20-857d-ef1987b7ed10 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046814 Jun 20 06:12:10.528247 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 446/916] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:12:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:11.007399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:11.008008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:11.014968 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.015505 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.016365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.016800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.157879 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.167874 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-37e91d88-e9c4-4063-b916-8039491421b3 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.164999 Jun 20 06:12:11.168472 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 471/917] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:11 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:11.830850 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-11871675", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dfe8112-b1c3-4379-ace8-53ea74527bdb"}], "security_groups": [{"name": "tempest-securitygroup--1198663645"}], "key_name": "tempest-keypair-802281984", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:11.929986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] validate_networks() for [('5dfe8112-b1c3-4379-ace8-53ea74527bdb', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:12:12.185731 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.186347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.193573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.194021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.194790 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.195227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.366420 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:12:12.366846 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:12:12.367347 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:12:12.367781 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:12:12.368193 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:12:12.382373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.382813 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.383737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.384286 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.398885 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.401093 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:12:12.404928 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:12:12.406227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-389905e1-414b-49ed-a76e-2a0848e06317 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.224363 Jun 20 06:12:12.406778 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 472/918] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:12.415935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:12:12.418221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:12:12.467371 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f86c65a4-60f3-44e5-8158-54d4744e51ee tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.641434 Jun 20 06:12:12.468007 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 447/919] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:12:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:12:12.478622 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f32611fd-577b-4bcf-89b3-6c90bfa56032 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.479276 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f32611fd-577b-4bcf-89b3-6c90bfa56032 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.533295 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f32611fd-577b-4bcf-89b3-6c90bfa56032 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.540908 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f32611fd-577b-4bcf-89b3-6c90bfa56032 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1239 microversion: 2.1 time: 0.066335 Jun 20 06:12:12.541558 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 473/920] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:13.423890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.424503 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.431364 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.431817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.432586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.433043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.571934 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.575824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.588927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.589440 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.590725 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.591172 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.656769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.666862 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7e2be337-944d-4497-874e-668b3b1136da tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.247415 Jun 20 06:12:13.673217 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 448/921] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:13.695881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.708173 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-773f4a05-24c1-4ed7-9413-4923429681dc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1299 microversion: 2.1 time: 0.153239 Jun 20 06:12:13.709896 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 474/922] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:14.691317 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.693296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.701156 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.701887 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.702671 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.703318 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.726815 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.728099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.735212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.735915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.736728 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.737717 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.919660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.929648 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-27c331fa-e540-4566-a8dd-684f2ef1a26e tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.242867 Jun 20 06:12:14.930238 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 449/923] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:14.952188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.961408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-00502720-bcdc-4d40-a466-0e6ce1c3b1cb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1365 microversion: 2.1 time: 0.238644 Jun 20 06:12:14.962148 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 475/924] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:15.411826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-a5a2d52e-6c1b-497f-bf2d-831ca4750c0f req-d6bc239e-c981-4f1d-8a47-53fa32f99645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172", "tag": "88c96cbe-5e06-46df-b44f-77221e1d8156"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:15.439145 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-a5a2d52e-6c1b-497f-bf2d-831ca4750c0f req-d6bc239e-c981-4f1d-8a47-53fa32f99645 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.440045 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-a5a2d52e-6c1b-497f-bf2d-831ca4750c0f req-d6bc239e-c981-4f1d-8a47-53fa32f99645 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.454313 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-a5a2d52e-6c1b-497f-bf2d-831ca4750c0f req-d6bc239e-c981-4f1d-8a47-53fa32f99645 service nova] Creating event network-changed:88c96cbe-5e06-46df-b44f-77221e1d8156 for instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 on hv-cinder-83699 Jun 20 06:12:15.460387 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-a5a2d52e-6c1b-497f-bf2d-831ca4750c0f req-d6bc239e-c981-4f1d-8a47-53fa32f99645 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061539 Jun 20 06:12:15.461249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 450/925] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:15.834643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-e73f7e0f-b002-4d72-ab6d-b8f12307083e req-90f35e5e-3a72-48c8-a0b6-163a0b7cd932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a6dca5-89dd-405d-8015-62e8cbcf08ac", "name": "network-vif-plugged", "status": "completed", "tag": "abd12247-83f5-467d-9fbd-501eb1f1c0e7"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:15.845134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-e73f7e0f-b002-4d72-ab6d-b8f12307083e req-90f35e5e-3a72-48c8-a0b6-163a0b7cd932 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.845588 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-e73f7e0f-b002-4d72-ab6d-b8f12307083e req-90f35e5e-3a72-48c8-a0b6-163a0b7cd932 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.857035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-e73f7e0f-b002-4d72-ab6d-b8f12307083e req-90f35e5e-3a72-48c8-a0b6-163a0b7cd932 service nova] Creating event network-vif-plugged:abd12247-83f5-467d-9fbd-501eb1f1c0e7 for instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac on hv-cinder-83699 Jun 20 06:12:15.862893 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-e73f7e0f-b002-4d72-ab6d-b8f12307083e req-90f35e5e-3a72-48c8-a0b6-163a0b7cd932 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032581 Jun 20 06:12:15.864571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 476/926] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:15.948749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:15.949479 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.956413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.956857 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.957659 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.958089 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.978744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:15.979473 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.985672 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.986204 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.987040 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.987550 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.399931 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.407748 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f51cbb50-3377-4f92-b59e-2513fe9da03f tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.463063 Jun 20 06:12:16.408315 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 451/927] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:15 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:16.411369 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.418851 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-458fe21d-0bb2-4bd3-975a-62c0d9dee392 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1365 microversion: 2.1 time: 0.444393 Jun 20 06:12:16.419396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 477/928] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:15 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:17.426163 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.427270 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.434204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.434661 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.435437 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.435554 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.435986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.436115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.443138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.443589 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.444353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.444785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.631293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.634315 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.639237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5c01165a-a25f-453b-b235-8ea390dc5f7d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1266 microversion: 2.1 time: 0.216828 Jun 20 06:12:17.639953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 452/929] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:17.642214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3ecc606f-9122-4e2a-aa02-c912c15873a8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1365 microversion: 2.1 time: 0.210271 Jun 20 06:12:17.642778 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 478/930] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:18.656444 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.657175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.658604 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.659714 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.664499 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.664946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.665746 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.666181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.666712 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.667171 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.667935 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.668375 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.860699 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:18.864723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:18.868187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5351344c-2678-4890-b020-2d8e5b6e77a1 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1454 microversion: 2.1 time: 0.216451 Jun 20 06:12:18.868751 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 453/931] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:18.872302 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9c8483d6-1e17-4882-a6cc-1c246a75912f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1365 microversion: 2.1 time: 0.217468 Jun 20 06:12:18.872845 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 479/932] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:18.884221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.884769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.890692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.891143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.892151 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.892595 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.028894 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:19.037314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-db1ec93f-7418-4e04-ace4-c0765e335e71 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1454 microversion: 2.1 time: 0.156729 Jun 20 06:12:19.037890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 454/933] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:19.845309 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-41681856-6bb8-48b4-ae1d-0cf720a66cbe req-e334da9d-fbb0-400b-93a2-d1a5eccd61b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172", "name": "network-vif-plugged", "status": "completed", "tag": "88c96cbe-5e06-46df-b44f-77221e1d8156"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:19.854226 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-41681856-6bb8-48b4-ae1d-0cf720a66cbe req-e334da9d-fbb0-400b-93a2-d1a5eccd61b9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.854683 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-41681856-6bb8-48b4-ae1d-0cf720a66cbe req-e334da9d-fbb0-400b-93a2-d1a5eccd61b9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.867201 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-41681856-6bb8-48b4-ae1d-0cf720a66cbe req-e334da9d-fbb0-400b-93a2-d1a5eccd61b9 service nova] Creating event network-vif-plugged:88c96cbe-5e06-46df-b44f-77221e1d8156 for instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 on hv-cinder-83699 Jun 20 06:12:19.873755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-41681856-6bb8-48b4-ae1d-0cf720a66cbe req-e334da9d-fbb0-400b-93a2-d1a5eccd61b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Jun 20 06:12:19.874343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 480/934] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:19.889516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:19.890927 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:19.898363 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.898811 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.900234 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.900674 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.116798 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:20.124899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9057e11b-9bb1-40f6-b2f1-6c5c4aae8bd4 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1365 microversion: 2.1 time: 0.239630 Jun 20 06:12:20.126341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 455/935] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:19 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:20.725598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-5f60d08f-7732-47a8-892c-fd58939be4a1 req-a9c641ee-81bb-4652-b24b-545f7c92bdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a6dca5-89dd-405d-8015-62e8cbcf08ac", "tag": "abd12247-83f5-467d-9fbd-501eb1f1c0e7"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:20.736634 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5f60d08f-7732-47a8-892c-fd58939be4a1 req-a9c641ee-81bb-4652-b24b-545f7c92bdc8 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.737238 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5f60d08f-7732-47a8-892c-fd58939be4a1 req-a9c641ee-81bb-4652-b24b-545f7c92bdc8 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.749452 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-5f60d08f-7732-47a8-892c-fd58939be4a1 req-a9c641ee-81bb-4652-b24b-545f7c92bdc8 service nova] Creating event network-changed:abd12247-83f5-467d-9fbd-501eb1f1c0e7 for instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac on hv-cinder-83699 Jun 20 06:12:20.754307 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-5f60d08f-7732-47a8-892c-fd58939be4a1 req-a9c641ee-81bb-4652-b24b-545f7c92bdc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033629 Jun 20 06:12:20.755092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 481/936] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:21.142645 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:21.143253 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:21.150501 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.150894 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.151692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.152128 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.281762 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.285311 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:21.291119 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9ca21f95-fd2c-4f31-8231-14ee37b22f98 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1365 microversion: 2.1 time: 0.152524 Jun 20 06:12:21.293052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 456/937] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:21 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:22.309669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.310373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.316427 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.317460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.318222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.318655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.454742 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.462934 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9663b263-61b2-4e50-8ea2-f92f99ef9876 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1556 microversion: 2.1 time: 0.157899 Jun 20 06:12:22.463595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 482/938] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:22.479821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.480324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.482615 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:22.483274 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=10 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:22.490734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.491401 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.492177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.492625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.570805 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fe126e83-22ed-4cb5-89a7-bdf3ef7f2d2a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095154 Jun 20 06:12:22.571431 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 457/939] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:23.782669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-9878f608-439c-41f3-b36a-640ed378e46e req-1b172a58-07b0-438a-8f5e-d8ccef7f7d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172", "tag": "88c96cbe-5e06-46df-b44f-77221e1d8156"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:23.788847 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:23.796052 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9878f608-439c-41f3-b36a-640ed378e46e req-1b172a58-07b0-438a-8f5e-d8ccef7f7d91 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.796881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9878f608-439c-41f3-b36a-640ed378e46e req-1b172a58-07b0-438a-8f5e-d8ccef7f7d91 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.809986 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-9878f608-439c-41f3-b36a-640ed378e46e req-1b172a58-07b0-438a-8f5e-d8ccef7f7d91 service nova] Creating event network-changed:88c96cbe-5e06-46df-b44f-77221e1d8156 for instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 on hv-cinder-83699 Jun 20 06:12:23.818020 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-9878f608-439c-41f3-b36a-640ed378e46e req-1b172a58-07b0-438a-8f5e-d8ccef7f7d91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043633 Jun 20 06:12:23.818868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 483/940] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:25.237767 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2079429885", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "networks": [{"uuid": "65e166cf-da39-4615-bd59-f01199cd7d16"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:25.288668 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] validate_networks() for [('65e166cf-da39-4615-bd59-f01199cd7d16', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:12:25.625003 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:12:25.625422 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:12:25.625890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:12:25.626296 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:12:25.626705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:12:25.635541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.636027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.636834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.637308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.654225 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Getting quotas for project ef60b159659943458cf925c59c537b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:12:25.658151 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Getting quotas for user cbc35723acd54c8199765e12a6a27d45 and project ef60b159659943458cf925c59c537b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:12:25.669833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:12:25.672030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:12:25.714700 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dae76eaa-ab94-414e-a50c-73ac46d43cad tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481646 Jun 20 06:12:25.715331 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 458/941] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:12:25.726609 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c584d42b-f80b-48a1-a504-28c46cdc7c29 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:25.727310 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c584d42b-f80b-48a1-a504-28c46cdc7c29 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:25.788877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c584d42b-f80b-48a1-a504-28c46cdc7c29 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.795846 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c584d42b-f80b-48a1-a504-28c46cdc7c29 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1214 microversion: 2.1 time: 0.074247 Jun 20 06:12:25.796419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 484/942] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:25 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:26.813362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:26.813977 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:26.822311 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.822776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.823537 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.823977 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.888902 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.897318 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-592ea67c-d28f-4d65-a7af-94b60b664ce1 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1272 microversion: 2.1 time: 0.088257 Jun 20 06:12:26.897884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 459/943] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:26 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:27.914840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:27.915450 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:27.922057 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.922498 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.923253 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.923679 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.942305 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:27.953177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-d558134f-eeee-4bd8-8a59-ac8b7a7fec7f req-2331133f-ed6d-44fe-8570-d54841189cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a55d433-fc51-4d52-88cc-eab1217f334b", "tag": "1572639e-dd59-4cab-866e-410a96b8a59f"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:27.968553 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d558134f-eeee-4bd8-8a59-ac8b7a7fec7f req-2331133f-ed6d-44fe-8570-d54841189cb9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.969179 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d558134f-eeee-4bd8-8a59-ac8b7a7fec7f req-2331133f-ed6d-44fe-8570-d54841189cb9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.989033 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-d558134f-eeee-4bd8-8a59-ac8b7a7fec7f req-2331133f-ed6d-44fe-8570-d54841189cb9 service nova] Creating event network-changed:1572639e-dd59-4cab-866e-410a96b8a59f for instance 4a55d433-fc51-4d52-88cc-eab1217f334b on hv-cinder-83699 Jun 20 06:12:27.996054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-d558134f-eeee-4bd8-8a59-ac8b7a7fec7f req-2331133f-ed6d-44fe-8570-d54841189cb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048421 Jun 20 06:12:27.997530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 460/944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:28.062666 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:28.070325 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a4ec0bec-9f35-4823-8055-946049c74dfd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1314 microversion: 2.1 time: 0.159890 Jun 20 06:12:28.070954 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 485/945] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:27 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:29.086921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:29.087611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:29.094309 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.094756 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.095507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.095935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.225497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.233092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-801fee47-78ca-43ff-8e25-f41560b77ab8 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1314 microversion: 2.1 time: 0.150310 Jun 20 06:12:29.233647 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 461/946] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:29 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:30.250109 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.250720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.257783 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.258230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.258987 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.259419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.392120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.402179 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3c5772cb-54c3-4539-9e64-564b5849a43e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1314 microversion: 2.1 time: 0.155820 Jun 20 06:12:30.402939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 486/947] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:30 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:31.419027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:31.419637 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:31.425885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.426362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.427117 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.428043 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.554211 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:31.561605 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-58888501-a8c7-4fd2-947d-88a802d2d641 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1314 microversion: 2.1 time: 0.146461 Jun 20 06:12:31.562161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 462/948] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:31 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:31.925316 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-fd14c210-d54c-4067-83c9-8549ad191fca req-03d20b6c-fce0-464d-b8e0-95d42bebd2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a55d433-fc51-4d52-88cc-eab1217f334b", "name": "network-vif-plugged", "status": "completed", "tag": "1572639e-dd59-4cab-866e-410a96b8a59f"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:31.935519 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-fd14c210-d54c-4067-83c9-8549ad191fca req-03d20b6c-fce0-464d-b8e0-95d42bebd2c6 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.936142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-fd14c210-d54c-4067-83c9-8549ad191fca req-03d20b6c-fce0-464d-b8e0-95d42bebd2c6 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.947734 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-fd14c210-d54c-4067-83c9-8549ad191fca req-03d20b6c-fce0-464d-b8e0-95d42bebd2c6 service nova] Creating event network-vif-plugged:1572639e-dd59-4cab-866e-410a96b8a59f for instance 4a55d433-fc51-4d52-88cc-eab1217f334b on hv-cinder-83699 Jun 20 06:12:31.952720 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-fd14c210-d54c-4067-83c9-8549ad191fca req-03d20b6c-fce0-464d-b8e0-95d42bebd2c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032055 Jun 20 06:12:31.953343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 487/949] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:32.578910 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:32.579524 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.586664 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.587109 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.587859 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.588288 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.718359 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:32.725652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-038e407e-6e58-4187-8b60-c6afc3f1fabd tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1314 microversion: 2.1 time: 0.150574 Jun 20 06:12:32.726204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 463/950] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:32 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:33.743282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:33.744008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:33.750454 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.750903 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.751686 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.752122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.892362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:33.899875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e6df2ff1-4e0c-440a-af38-f796bd3d246f tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1498 microversion: 2.1 time: 0.161782 Jun 20 06:12:33.900489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 488/951] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:33 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:34.399394 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:34.399922 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:34.405961 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.406408 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.407184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.407624 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.432329 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:12:34.504036 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dab8a3ba-c925-41c0-bf5e-683f55014aed tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 204 len: 0 microversion: 2.1 time: 0.108175 Jun 20 06:12:34.504616 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 464/952] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:12:34 2022] DELETE /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:12:34.513613 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:34.514225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:34.520324 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.520774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.522077 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.522512 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.656831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:34.664657 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ec0f97ef-9280-4377-a8d9-4520183d6c23 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1504 microversion: 2.1 time: 0.154854 Jun 20 06:12:34.665246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 489/953] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:34 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:35.682771 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:35.683475 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:35.685864 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:35.686673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:35.692165 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.692611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.693409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.693844 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.820709 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:35.828074 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-01f7b2b8-d9a1-48bf-aef8-45528fb98850 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1504 microversion: 2.1 time: 0.149508 Jun 20 06:12:35.828631 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 465/954] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:35 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:36.832933 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-66ab9f5d-5dcf-4ea6-802d-b6cff548bdcd req-a4f2c45c-0ce5-45f8-b974-ed29a4d71540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a55d433-fc51-4d52-88cc-eab1217f334b", "name": "network-vif-deleted", "tag": "1572639e-dd59-4cab-866e-410a96b8a59f"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:36.836912 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:36.842624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-66ab9f5d-5dcf-4ea6-802d-b6cff548bdcd req-a4f2c45c-0ce5-45f8-b974-ed29a4d71540 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.843072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-66ab9f5d-5dcf-4ea6-802d-b6cff548bdcd req-a4f2c45c-0ce5-45f8-b974-ed29a4d71540 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.846099 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.846821 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.854917 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.855500 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.855707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-66ab9f5d-5dcf-4ea6-802d-b6cff548bdcd req-a4f2c45c-0ce5-45f8-b974-ed29a4d71540 service nova] Creating event network-vif-deleted:1572639e-dd59-4cab-866e-410a96b8a59f for instance 4a55d433-fc51-4d52-88cc-eab1217f334b on hv-cinder-83699 Jun 20 06:12:36.856429 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.857028 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.861159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-66ab9f5d-5dcf-4ea6-802d-b6cff548bdcd req-a4f2c45c-0ce5-45f8-b974-ed29a4d71540 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031949 Jun 20 06:12:36.861941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 490/955] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:36.919428 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:36.927665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1f2f88db-c84d-416e-aa70-6e8ac9325af7 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 200 len: 1462 microversion: 2.1 time: 0.085266 Jun 20 06:12:36.928231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 466/956] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:37.946633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:37.947322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 4a55d433-fc51-4d52-88cc-eab1217f334b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:37.953465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.953911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.954662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.955089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.971871 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] HTTP exception thrown: Instance 4a55d433-fc51-4d52-88cc-eab1217f334b could not be found. Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Request method failure captured: Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b HTTP/1.1 Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA_HVDCHo77S1Kx2RxlmgJRLOnu-6Hihal4cRjLEKYjXhj3vFhrwzJGq9JcR3k8MzdClg_97lFLfpqxl5gc5XMyr2SJWukky7WKHc8dEzcD30yvTC5di-FBDYqfj9CH8fxyXzH8IDGdMnHMXI23Y8joMfmRklbF89lePd5RiQJ2AbMk Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ef60b159659943458cf925c59c537b4a Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesActionsTest-689075157 Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:12:37.973785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef60b159659943458cf925c59c537b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef60b159659943458cf925c59c537b4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef60b159659943458cf925c59c537b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef60b159659943458cf925c59c537b4a", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesActionsTest-689075157 Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ef60b159659943458cf925c59c537b4a Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesActionsTest-689075157 Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesActionsTest-689075157-project Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: cbc35723acd54c8199765e12a6a27d45 Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesActionsTest-689075157-project Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 4a55d433-fc51-4d52-88cc-eab1217f334b could not be found. Jun 20 06:12:37.975873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '4a55d433-fc51-4d52-88cc-eab1217f334b'} Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a55d433-fc51-4d52-88cc-eab1217f334b could not be found. Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:37.976752 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a55d433-fc51-4d52-88cc-eab1217f334b could not be found. Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a55d433-fc51-4d52-88cc-eab1217f334b could not be found. Jun 20 06:12:37.978438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:37.980175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Returning 404 to user: Instance 4a55d433-fc51-4d52-88cc-eab1217f334b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:37.980175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2d1421ab-9143-45be-b201-b5c5ad3dfc55 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b" status: 404 len: 111 microversion: 2.1 time: 0.034180 Jun 20 06:12:37.980175 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 491/957] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:37 2022] GET /compute/v2.1/servers/4a55d433-fc51-4d52-88cc-eab1217f334b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:38.023283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1237108741", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "networks": [{"uuid": "65e166cf-da39-4615-bd59-f01199cd7d16"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:38.073899 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] validate_networks() for [('65e166cf-da39-4615-bd59-f01199cd7d16', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:12:38.408291 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:12:38.408717 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:12:38.409228 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:12:38.409636 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:12:38.410050 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:12:38.418776 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.419239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.420032 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.420463 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.436734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Getting quotas for project ef60b159659943458cf925c59c537b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:12:38.440662 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Getting quotas for user cbc35723acd54c8199765e12a6a27d45 and project ef60b159659943458cf925c59c537b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:12:38.443407 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:38.455056 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:12:38.457310 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:12:38.502374 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bf78e723-0d84-4fd0-926b-e33f02f1db0a tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483322 Jun 20 06:12:38.503037 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 467/958] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:12:38.513484 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-650afe7e-12aa-4e15-952e-1e877a59d332 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:38.514225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-650afe7e-12aa-4e15-952e-1e877a59d332 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:38.570836 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-650afe7e-12aa-4e15-952e-1e877a59d332 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:38.577598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-650afe7e-12aa-4e15-952e-1e877a59d332 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1214 microversion: 2.1 time: 0.067993 Jun 20 06:12:38.578168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 492/959] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:38 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:39.595048 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:39.595665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:39.603172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.603621 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.604387 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.604819 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.667952 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:39.675341 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5f67fd74-8595-4f37-9954-f6d1b450dd28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1272 microversion: 2.1 time: 0.084173 Jun 20 06:12:39.676124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 468/960] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:39 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:40.692810 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:40.693456 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:40.695835 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=54 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:40.701939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.702389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.703149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.703586 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.800185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-02e2fddc-af42-4902-ae42-700d85a91e5e req-a2f4e3fd-a37c-4da5-95ae-9d2ca34b03bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4a9836-3e27-4ef6-8e20-653dab0739f2", "tag": "16d5919f-093e-419f-a76c-b77919de0556"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:40.820478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-02e2fddc-af42-4902-ae42-700d85a91e5e req-a2f4e3fd-a37c-4da5-95ae-9d2ca34b03bc service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.821066 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-02e2fddc-af42-4902-ae42-700d85a91e5e req-a2f4e3fd-a37c-4da5-95ae-9d2ca34b03bc service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.833324 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-02e2fddc-af42-4902-ae42-700d85a91e5e req-a2f4e3fd-a37c-4da5-95ae-9d2ca34b03bc service nova] Creating event network-changed:16d5919f-093e-419f-a76c-b77919de0556 for instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 on hv-cinder-83699 Jun 20 06:12:40.838208 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-02e2fddc-af42-4902-ae42-700d85a91e5e req-a2f4e3fd-a37c-4da5-95ae-9d2ca34b03bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041755 Jun 20 06:12:40.838828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 469/961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:40.845580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:40.853511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7d01e96d-79f7-463a-bc7d-ed14d58378b4 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.164509 Jun 20 06:12:40.854076 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 493/962] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:40 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:41.871150 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:41.871846 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:41.878062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.878509 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.879257 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.879689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.013097 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:42.021181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a458b17e-4cc3-427a-a251-2b8e9b5050ae tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.154193 Jun 20 06:12:42.021740 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 470/963] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:41 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:43.038228 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:43.038838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:43.046307 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.046874 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:43.047821 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.048268 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:43.175195 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:43.183690 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c1bec96f-9ff6-49e6-bfca-5ea92630fa2e tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.149710 Jun 20 06:12:43.184255 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 494/964] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:43 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:44.200726 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:44.201373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:44.207755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:44.208228 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:44.208992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:44.209433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:44.335201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:44.342507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f38e40c1-6314-4ab8-97a7-b060f336b811 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.145548 Jun 20 06:12:44.343068 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 471/965] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:44 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:45.359636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:45.360243 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:45.367342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.367812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.368566 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.369019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.502219 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:45.509662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dccd3239-f2da-4da9-9e19-c48f4a1cb309 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.153858 Jun 20 06:12:45.510222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 495/966] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:45 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:46.003433 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-4ef139bd-91d7-4930-8a50-76120b65c1d9 req-0ec28c19-5024-448f-9050-d549a15d2b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4a9836-3e27-4ef6-8e20-653dab0739f2", "name": "network-vif-plugged", "status": "completed", "tag": "16d5919f-093e-419f-a76c-b77919de0556"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:46.014054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-4ef139bd-91d7-4930-8a50-76120b65c1d9 req-0ec28c19-5024-448f-9050-d549a15d2b47 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.014519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-4ef139bd-91d7-4930-8a50-76120b65c1d9 req-0ec28c19-5024-448f-9050-d549a15d2b47 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.026379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-4ef139bd-91d7-4930-8a50-76120b65c1d9 req-0ec28c19-5024-448f-9050-d549a15d2b47 service nova] Creating event network-vif-plugged:16d5919f-093e-419f-a76c-b77919de0556 for instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 on hv-cinder-83699 Jun 20 06:12:46.031185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-4ef139bd-91d7-4930-8a50-76120b65c1d9 req-0ec28c19-5024-448f-9050-d549a15d2b47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Jun 20 06:12:46.031921 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 472/967] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:46.527174 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:46.527620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:46.533981 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.534453 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.535216 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.535653 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.662788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:46.670111 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9d146883-0814-4613-95cb-4893a7505d28 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.147090 Jun 20 06:12:46.670671 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 496/968] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:46 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:47.686517 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:47.687213 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:47.694516 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.694967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.695720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.696155 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.828409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:47.836184 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-635d9d1f-5692-432c-b44d-ae29f494ee21 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1314 microversion: 2.1 time: 0.154103 Jun 20 06:12:47.836732 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 473/969] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:47 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:48.853075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:48.853723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:48.856196 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:48.861661 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.862115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.862932 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.863317 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.990120 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:48.997490 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dcf49486-f167-48a2-b23a-70156bd8f90b tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1499 microversion: 2.1 time: 0.148790 Jun 20 06:12:48.998123 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 497/970] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:48 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1499 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:49.498579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:49.499081 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:49.501024 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:49.501672 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:49.508665 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:49.509149 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:49.509905 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:49.510358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:49.534733 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:12:49.560192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:49.607625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0d743c38-7f93-4b86-be3f-e49d7a7c3ff9 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 204 len: 0 microversion: 2.1 time: 0.112445 Jun 20 06:12:49.608221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 474/971] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:12:49 2022] DELETE /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:12:49.617115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:49.617726 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:49.623709 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:49.624160 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:49.624922 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:49.625408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:49.755981 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:49.763461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-13e0d038-1c32-4451-a8ec-ac933a69a149 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1505 microversion: 2.1 time: 0.150965 Jun 20 06:12:49.764013 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 498/972] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:49 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:50.781936 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:50.782647 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:50.789086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.789538 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.790295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.790730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.919227 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:50.927221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f017e94f-9787-4695-8d8c-b3ed1eca1767 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1505 microversion: 2.1 time: 0.148975 Jun 20 06:12:50.927777 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 475/973] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:50 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:51.686470 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-38ece182-2540-4b89-8062-166fc38ed10c req-3f985cd7-30f9-4090-9902-4b49efe7ad29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4a9836-3e27-4ef6-8e20-653dab0739f2", "name": "network-vif-deleted", "tag": "16d5919f-093e-419f-a76c-b77919de0556"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:51.695507 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-38ece182-2540-4b89-8062-166fc38ed10c req-3f985cd7-30f9-4090-9902-4b49efe7ad29 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.696078 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-38ece182-2540-4b89-8062-166fc38ed10c req-3f985cd7-30f9-4090-9902-4b49efe7ad29 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.707358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-38ece182-2540-4b89-8062-166fc38ed10c req-3f985cd7-30f9-4090-9902-4b49efe7ad29 service nova] Creating event network-vif-deleted:16d5919f-093e-419f-a76c-b77919de0556 for instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 on hv-cinder-83699 Jun 20 06:12:51.712693 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-38ece182-2540-4b89-8062-166fc38ed10c req-3f985cd7-30f9-4090-9902-4b49efe7ad29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029972 Jun 20 06:12:51.713309 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 499/974] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:51.943811 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:51.944424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:51.950897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.951381 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.952136 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.952572 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.985293 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.985741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.986187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lazy-loading 'fault' on Instance uuid 0e4a9836-3e27-4ef6-8e20-653dab0739f2 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:12:52.027118 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc35723acd54c8199765e12a6a27d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef60b159659943458cf925c59c537b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:52.034467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-97b658cf-c65d-4e80-9de0-1f2f69010789 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 200 len: 1304 microversion: 2.1 time: 0.094660 Jun 20 06:12:52.035025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 476/975] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:51 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:53.057626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:53.058334 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] [instance: 0e4a9836-3e27-4ef6-8e20-653dab0739f2] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:53.064563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:53.065073 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.065844 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:53.066277 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.079417 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] HTTP exception thrown: Instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 could not be found. Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Request method failure captured: Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 HTTP/1.1 Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA_HVDCHo77S1Kx2RxlmgJRLOnu-6Hihal4cRjLEKYjXhj3vFhrwzJGq9JcR3k8MzdClg_97lFLfpqxl5gc5XMyr2SJWukky7WKHc8dEzcD30yvTC5di-FBDYqfj9CH8fxyXzH8IDGdMnHMXI23Y8joMfmRklbF89lePd5RiQJ2AbMk Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: ef60b159659943458cf925c59c537b4a Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesActionsTest-689075157 Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:12:53.081050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef60b159659943458cf925c59c537b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef60b159659943458cf925c59c537b4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef60b159659943458cf925c59c537b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef60b159659943458cf925c59c537b4a", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesActionsTest-689075157 Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ef60b159659943458cf925c59c537b4a Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesActionsTest-689075157 Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesActionsTest-689075157-project Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: cbc35723acd54c8199765e12a6a27d45 Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesActionsTest-689075157-project Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 could not be found. Jun 20 06:12:53.083198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '0e4a9836-3e27-4ef6-8e20-653dab0739f2'} Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 could not be found. Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:53.084102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 could not be found. Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 could not be found. Jun 20 06:12:53.085603 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:12:53.086831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] Returning 404 to user: Instance 0e4a9836-3e27-4ef6-8e20-653dab0739f2 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:53.086831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a3ff2106-fab9-4b61-a881-261b0f36e6f6 tempest-VolumesActionsTest-689075157 tempest-VolumesActionsTest-689075157-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2" status: 404 len: 111 microversion: 2.1 time: 0.029580 Jun 20 06:12:53.086831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 500/976] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:53 2022] GET /compute/v2.1/servers/0e4a9836-3e27-4ef6-8e20-653dab0739f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:07.371678 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:07.372239 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:07.374688 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:07.375494 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:07.381523 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.381979 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.382749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.383194 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.410526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2181fef3-29b0-4ef2-b833-f7382b0521fa tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/ips" status: 200 len: 151 microversion: 2.1 time: 0.042922 Jun 20 06:13:07.411697 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 477/977] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:13:07 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:08.816043 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:08.818435 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:08.823995 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=15 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:08.825106 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=66 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:08.827121 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.827576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.828565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.829024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.151677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-234249e0-77c6-4cd5-95f6-8ab6c8478eb3 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339283 Jun 20 06:13:09.152675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 501/978] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:13:08 2022] POST /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:13:16.654748 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:16.655843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:16.662270 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.662720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.663487 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.663923 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.742743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Invalid volume: volume a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 is already attached to instances: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments HTTP/1.1 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 74 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:13:16.744488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {"volumeAttachment": {"volumeId": "a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3"}} Jun 20 06:13:16.746263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Invalid volume: volume a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 is already attached to instances: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'server_id': 'ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172', 'body': {'volumeAttachment': {'volumeId': 'a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3'}}} Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 is already attached to instances: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:13:16.747233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 is already attached to instances: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:16.748711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 is already attached to instances: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 400 to user: Invalid volume: volume a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 is already attached to instances: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-be298e4b-2cc3-4128-993c-62c45b2501fb tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095233 Jun 20 06:13:16.750276 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 478/979] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:13:16 2022] POST /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:13:16.806385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:16.806984 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:16.813348 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.813806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.814677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.815122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.893723 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lazy-loading 'services' on Instance uuid ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:13:16.962509 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-21e69f3b-0870-4655-9788-aef7aacefbaf tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments/a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3" status: 202 len: 0 microversion: 2.1 time: 0.160924 Jun 20 06:13:16.963083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 502/980] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:13:16 2022] DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments/a2f405f9-cfb2-4bf0-b657-44c6d3efc8d3 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:13:16.971357 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:16.972878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:16.978506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.978956 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.979720 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.980157 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:17.011800 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a66f4007-ee7a-4555-a081-7d22cb6ebe42 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Jun 20 06:13:17.012365 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 479/981] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:13:16 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:18.023633 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:18.024703 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:18.030959 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.031407 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.032165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.032599 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.060617 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-12c5eda6-afe2-4f0a-b755-3ebfce2780ea tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041602 Jun 20 06:13:18.061113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 503/982] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:13:18 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:13:18.117250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:18.117764 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:18.124202 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.124651 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.125452 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.125885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.150731 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:13:18.227871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cffa056d-dd5a-47e5-8e82-150b8a84277c tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 204 len: 0 microversion: 2.1 time: 0.114621 Jun 20 06:13:18.228575 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 480/983] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:13:18 2022] DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:13:18.236876 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:18.237594 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:18.244186 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.244642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.245430 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.245865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.372197 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:18.379590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0ecff039-dd36-4add-b112-82b51fe25522 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1681 microversion: 2.1 time: 0.146636 Jun 20 06:13:18.380154 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 504/984] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:18 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:19.397919 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:19.398639 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:19.404968 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:19.405442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:19.406189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:19.406619 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:19.536394 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:19.543833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c72d1f7c-e9c4-4ec8-a4ee-9feeffb13440 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1681 microversion: 2.1 time: 0.150128 Jun 20 06:13:19.544393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 481/985] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:19 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:20.561749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:20.563168 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:20.571001 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.571451 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.572433 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.572822 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.640180 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:20.649208 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ffaba7f8-f74a-4f4e-80cc-e4dc74d87296 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 200 len: 1613 microversion: 2.1 time: 0.091498 Jun 20 06:13:20.650064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 505/986] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:20 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:20.914316 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-f665df6a-0b28-4357-b376-61301c6ef1f1 req-4ce5301e-48f7-4178-84dd-88b2dd5c0a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172", "name": "network-vif-deleted", "tag": "88c96cbe-5e06-46df-b44f-77221e1d8156"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:20.924837 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-f665df6a-0b28-4357-b376-61301c6ef1f1 req-4ce5301e-48f7-4178-84dd-88b2dd5c0a7a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.925970 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-f665df6a-0b28-4357-b376-61301c6ef1f1 req-4ce5301e-48f7-4178-84dd-88b2dd5c0a7a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.938212 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-f665df6a-0b28-4357-b376-61301c6ef1f1 req-4ce5301e-48f7-4178-84dd-88b2dd5c0a7a service nova] Creating event network-vif-deleted:88c96cbe-5e06-46df-b44f-77221e1d8156 for instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 on hv-cinder-83699 Jun 20 06:13:20.944783 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-f665df6a-0b28-4357-b376-61301c6ef1f1 req-4ce5301e-48f7-4178-84dd-88b2dd5c0a7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034087 Jun 20 06:13:20.945916 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 482/987] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:21.666909 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:21.667536 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:21.674055 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.674506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.675272 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.675702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.689772 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 HTTP/1.1 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:13:21.691250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:13:21.692942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172'} Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:21.693825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:13:21.695134 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:13:21.696857 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:21.696857 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b90a8d15-1a8c-4be6-af59-7155742d6945 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 404 len: 111 microversion: 2.1 time: 0.029656 Jun 20 06:13:21.696857 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 506/988] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:21 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:21.702406 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-98416d6f-3bc8-43ba-a30c-2e91e3457297 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '.version_select at 0x7f9d442f0040>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:21.720448 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-98416d6f-3bc8-43ba-a30c-2e91e3457297 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802281984" status: 202 len: 0 microversion: 2.1 time: 0.022223 Jun 20 06:13:21.721152 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 483/989] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 20 06:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802281984 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:13:22.336664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3c96b34a-add0-4cf9-b615-5167e7cffa5e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: .version_select at 0x7f9d48a3aca0>, body: {"keypair": {"name": "tempest-keypair-736142014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5w1tjOnO7WrOZYSfVG0sKllxJBrnYqG391R9AUW95Ehgtp2OobKpe6mosZRyOk52tN8U9NHeSoDVYHpjFt6lDzPratxQWQut3bnSrjA8lbMmDc3LfIHLvguNmwePAcag=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:22.350169 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-3c96b34a-add0-4cf9-b615-5167e7cffa5e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:13:22.353878 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-3c96b34a-add0-4cf9-b615-5167e7cffa5e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:13:22.375960 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3c96b34a-add0-4cf9-b615-5167e7cffa5e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043127 Jun 20 06:13:22.376534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 507/990] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:13:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:23.612777 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1022310545", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dfe8112-b1c3-4379-ace8-53ea74527bdb"}], "security_groups": [{"name": "tempest-securitygroup--1115735279"}], "key_name": "tempest-keypair-736142014", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:23.713121 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] validate_networks() for [('5dfe8112-b1c3-4379-ace8-53ea74527bdb', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:13:24.081562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:13:24.081993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:13:24.082518 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:13:24.082932 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:13:24.083346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:13:24.092008 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:24.092455 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:24.093283 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:24.093722 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:24.113712 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:13:24.117640 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Getting quotas for user 96ed46e793334426bad6055e2085dacf and project 31f7b47f81a74868910102abb1d8a8e0. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:13:24.128352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:13:24.130708 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:13:24.176646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3efea380-921d-47ad-86af-63fe3013b614 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568998 Jun 20 06:13:24.177526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 484/991] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:13:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:13:24.187246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0a645a11-2fea-4d3c-bc16-a8eca459d708 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:24.188206 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a645a11-2fea-4d3c-bc16-a8eca459d708 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:24.242463 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0a645a11-2fea-4d3c-bc16-a8eca459d708 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:24.249111 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0a645a11-2fea-4d3c-bc16-a8eca459d708 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1241 microversion: 2.1 time: 0.065712 Jun 20 06:13:24.258373 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 508/992] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:24 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:25.266028 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:25.267295 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:25.274701 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.275201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.276162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.276600 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.344955 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:25.353545 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5f14d28f-7863-411e-ac91-99b74236e80a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1311 microversion: 2.1 time: 0.092149 Jun 20 06:13:25.354307 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 485/993] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:25 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:26.371223 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:26.371823 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:26.379363 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.379827 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:26.380627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.381122 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:26.518123 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:26.526176 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7881c356-ae3b-40b4-97ce-f6da2438ff49 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.158820 Jun 20 06:13:26.526741 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 509/994] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:26 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:26.919964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-c5834bd8-ca11-4331-88fe-a3968cb6413e req-1c9d4bd1-660e-4a43-a977-745200e78224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c49a3f-a844-456a-85ea-9dd2653cf3ae", "tag": "b1734c76-38df-4944-8061-0ffe6e4d2b5e"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:26.934130 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-c5834bd8-ca11-4331-88fe-a3968cb6413e req-1c9d4bd1-660e-4a43-a977-745200e78224 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.935478 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-c5834bd8-ca11-4331-88fe-a3968cb6413e req-1c9d4bd1-660e-4a43-a977-745200e78224 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:26.949349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-c5834bd8-ca11-4331-88fe-a3968cb6413e req-1c9d4bd1-660e-4a43-a977-745200e78224 service nova] Creating event network-changed:b1734c76-38df-4944-8061-0ffe6e4d2b5e for instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae on hv-cinder-83699 Jun 20 06:13:26.956363 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-c5834bd8-ca11-4331-88fe-a3968cb6413e req-1c9d4bd1-660e-4a43-a977-745200e78224 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039080 Jun 20 06:13:26.956871 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 486/995] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:27.543592 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:27.544159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:27.550583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.551035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.551780 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.552240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.677362 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:27.684608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0f2cf15d-c140-4841-a788-1e8aac63d0a5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.144912 Jun 20 06:13:27.685198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 510/996] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:27 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:28.702467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:28.703203 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:28.709245 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:28.709691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.710443 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:28.710988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.841181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:28.849254 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-76825bac-1d42-4d62-b1a7-409b4521a1b6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.151535 Jun 20 06:13:28.849817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 487/997] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:28 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:29.866233 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:29.866849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:29.873330 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.873788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:29.874555 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.874996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:30.001971 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:30.009962 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b21e202a-5a18-49bd-a609-bf39d0dfefad tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.148062 Jun 20 06:13:30.010520 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 511/998] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:29 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:31.026896 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:31.027511 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:31.034002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.034454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.035218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.035652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.159607 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:31.167061 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3a1459c1-9ecc-4793-93ad-96151f6f8737 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.144001 Jun 20 06:13:31.167630 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 488/999] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:31 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:32.183900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:32.184510 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:32.191003 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.191562 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.192322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.192756 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.206551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-8eaee093-01b6-40d1-9706-beb6bc739896 req-584167f7-072f-437e-8e8f-57eaaa6ce042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c49a3f-a844-456a-85ea-9dd2653cf3ae", "name": "network-vif-plugged", "status": "completed", "tag": "b1734c76-38df-4944-8061-0ffe6e4d2b5e"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:32.216099 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-8eaee093-01b6-40d1-9706-beb6bc739896 req-584167f7-072f-437e-8e8f-57eaaa6ce042 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.216566 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-8eaee093-01b6-40d1-9706-beb6bc739896 req-584167f7-072f-437e-8e8f-57eaaa6ce042 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.231013 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-8eaee093-01b6-40d1-9706-beb6bc739896 req-584167f7-072f-437e-8e8f-57eaaa6ce042 service nova] Creating event network-vif-plugged:b1734c76-38df-4944-8061-0ffe6e4d2b5e for instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae on hv-cinder-83699 Jun 20 06:13:32.237204 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-8eaee093-01b6-40d1-9706-beb6bc739896 req-584167f7-072f-437e-8e8f-57eaaa6ce042 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Jun 20 06:13:32.238010 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 489/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:13:32.330444 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:32.338488 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d119cf26-aa8f-49e5-9963-e637b68d6ec2 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.158390 Jun 20 06:13:32.339085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 512/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:32 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:33.357047 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:33.357744 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:33.363865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.364308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:33.365086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.365519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:33.490986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:33.498251 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4f1a72be-2f82-4a8c-80da-32721f1f495e tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1367 microversion: 2.1 time: 0.145848 Jun 20 06:13:33.498804 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 490/1002] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:33 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:34.515662 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:34.516276 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:34.519084 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:34.524303 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:34.524761 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.525551 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:34.525998 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.655010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:34.662877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-898e6fdd-9936-4fa4-95e0-d3c3213cd983 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1558 microversion: 2.1 time: 0.151114 Jun 20 06:13:34.663441 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 513/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:34 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:34.679361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:34.679840 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:34.682001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:34.682640 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:34.688335 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:34.688781 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.689701 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:34.690137 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.764504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8b0d319a-0c77-4602-b069-47dda0e87c43 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089457 Jun 20 06:13:34.765142 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 491/1004] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 20 06:13:34 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:35.914460 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-9070f083-1bde-4c0e-a961-657a2a65dabf req-fc5908ff-8c5a-4a72-ac0a-2d573c20410d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c49a3f-a844-456a-85ea-9dd2653cf3ae", "tag": "b1734c76-38df-4944-8061-0ffe6e4d2b5e"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:35.923096 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9070f083-1bde-4c0e-a961-657a2a65dabf req-fc5908ff-8c5a-4a72-ac0a-2d573c20410d service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.923620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9070f083-1bde-4c0e-a961-657a2a65dabf req-fc5908ff-8c5a-4a72-ac0a-2d573c20410d service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.935595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-9070f083-1bde-4c0e-a961-657a2a65dabf req-fc5908ff-8c5a-4a72-ac0a-2d573c20410d service nova] Creating event network-changed:b1734c76-38df-4944-8061-0ffe6e4d2b5e for instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae on hv-cinder-83699 Jun 20 06:13:35.940653 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-9070f083-1bde-4c0e-a961-657a2a65dabf req-fc5908ff-8c5a-4a72-ac0a-2d573c20410d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029834 Jun 20 06:13:35.942105 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 514/1005] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:00.467537 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:14:00.468203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Mon Jun 20 06:14:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:14:07.982121 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:07.983108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:07.986857 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1850715490", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-724460958", "security_groups": [{"name": "tempest-secgroup-smoke-1378745963"}], "block_device_mapping_v2": [{"uuid": "c2277f43-a786-41b2-93f0-9376007619b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82f005d7-3296-4650-9513-388af91b26c4"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:08.206054 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] validate_networks() for [('82f005d7-3296-4650-9513-388af91b26c4', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:08.573755 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:08.574181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:08.574678 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:08.575086 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:08.575496 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:08.584702 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.585186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.585987 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.586421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.602467 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for project 888311b555bb436ca9bc99aed66458d5. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:08.606263 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Getting quotas for user 8a4b39d3a27c4077b88cd0802a240b53 and project 888311b555bb436ca9bc99aed66458d5. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:08.661680 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:08.663795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2277f43-a786-41b2-93f0-9376007619b8',volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:08.787177 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-40d47931-c9e4-4bc6-9ed7-b0bdde505fa5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806367 Jun 20 06:14:08.787820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 492/1006] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:08.795797 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.796552 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.800840 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d1cafd7-7c4f-4af2-903d-53a75c419e5b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:08.801762 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2d1cafd7-7c4f-4af2-903d-53a75c419e5b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:08.968440 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2d1cafd7-7c4f-4af2-903d-53a75c419e5b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:08.976788 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2d1cafd7-7c4f-4af2-903d-53a75c419e5b tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1094 microversion: 2.1 time: 0.182489 Jun 20 06:14:08.977432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 515/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:08 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1094 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:09.995423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:09.996040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:10.002159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:10.002605 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.003360 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:10.003795 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.077477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:10.084932 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-30f3df69-b4cc-4a34-a17b-755499d3c7eb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1210 microversion: 2.1 time: 0.094017 Jun 20 06:14:10.085515 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 493/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:09 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:11.103957 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:11.104701 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:11.112730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.113213 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.114279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.114889 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.204507 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-26ba9a71-a6ff-4563-b02f-413d47039f61 req-a06d6ddd-7a5d-471d-9e4e-70cfe18bda42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bdac5a-91af-42a7-b8ed-97580b24acfc", "tag": "585d0ae7-33b2-4f09-aac0-a0ba4271f187"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:11.232153 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-26ba9a71-a6ff-4563-b02f-413d47039f61 req-a06d6ddd-7a5d-471d-9e4e-70cfe18bda42 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.232692 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-26ba9a71-a6ff-4563-b02f-413d47039f61 req-a06d6ddd-7a5d-471d-9e4e-70cfe18bda42 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.251187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-26ba9a71-a6ff-4563-b02f-413d47039f61 req-a06d6ddd-7a5d-471d-9e4e-70cfe18bda42 service nova] Creating event network-changed:585d0ae7-33b2-4f09-aac0-a0ba4271f187 for instance 99bdac5a-91af-42a7-b8ed-97580b24acfc on hv-cinder-83699 Jun 20 06:14:11.258170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-26ba9a71-a6ff-4563-b02f-413d47039f61 req-a06d6ddd-7a5d-471d-9e4e-70cfe18bda42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057315 Jun 20 06:14:11.259063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 494/1009] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:11.290079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:11.299334 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-76a7a09c-4b6f-4aac-992b-75c4e2967f06 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.201015 Jun 20 06:14:11.300573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 516/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:11 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:12.316740 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:12.317474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:12.324334 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.324796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.325610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.326055 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.457000 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:12.464851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-00873fd0-3b4a-4905-89ff-337684abfb0d tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.152463 Jun 20 06:14:12.465454 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 495/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:12 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:13.481785 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:13.482349 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:13.488760 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:13.489253 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:13.490533 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:13.490972 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:13.622749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:13.630109 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fbfdb8fc-8020-48dc-8072-0b635d275062 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.152266 Jun 20 06:14:13.630660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 517/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:13 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:14.647027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:14.647643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:14.654125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.654581 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.655346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.655784 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.782172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:14.789564 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2072177d-2fd2-4ff3-b955-f9d1ea0bcf45 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.146408 Jun 20 06:14:14.790126 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 496/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:14 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:15.806773 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:15.807380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:15.813808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:15.814254 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.815039 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:15.815469 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.945158 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:15.952947 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-58062ca3-4eac-4335-94d9-34f8d0236f29 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.150595 Jun 20 06:14:15.953688 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 518/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:15 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:16.969988 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:16.970533 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:16.977644 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.978100 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.978860 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.979297 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.108623 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:17.116075 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-48f51253-6b41-4bf4-bfd7-0639643a2238 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.150059 Jun 20 06:14:17.116644 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 497/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:16 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:18.133199 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:18.133811 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:18.140263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.140713 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.141504 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.141943 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.280365 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:18.288246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-12f3110b-a143-48df-83a6-51a9a93aefaa tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.159411 Jun 20 06:14:18.288802 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 519/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:18 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:19.305399 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:19.306019 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:19.308423 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:19.309181 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:19.314903 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.315362 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.316129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.316571 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.444386 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:19.451794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b551ac7d-3605-4eeb-bdad-6a5385e31233 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.150809 Jun 20 06:14:19.452348 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 498/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:19 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:19.562367 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:19.562870 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:19.564669 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:19.570295 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.570755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.571563 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.572006 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.593914 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0db7dfd8-4a31-4494-93f7-d48e77368073 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/ips" status: 200 len: 151 microversion: 2.1 time: 0.035450 Jun 20 06:14:19.594465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 520/1018] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 20 06:14:19 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:20.469881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:20.470534 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:20.477097 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.477529 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.478365 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.478851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.549747 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-62f15f1f-740a-4f1e-a475-aa3225e5da6e req-210825ed-7842-4e6f-b9c2-4829d87b6b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bdac5a-91af-42a7-b8ed-97580b24acfc", "name": "network-vif-plugged", "status": "completed", "tag": "585d0ae7-33b2-4f09-aac0-a0ba4271f187"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:20.558359 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-62f15f1f-740a-4f1e-a475-aa3225e5da6e req-210825ed-7842-4e6f-b9c2-4829d87b6b90 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.559694 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-62f15f1f-740a-4f1e-a475-aa3225e5da6e req-210825ed-7842-4e6f-b9c2-4829d87b6b90 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.573940 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-62f15f1f-740a-4f1e-a475-aa3225e5da6e req-210825ed-7842-4e6f-b9c2-4829d87b6b90 service nova] Creating event network-vif-plugged:585d0ae7-33b2-4f09-aac0-a0ba4271f187 for instance 99bdac5a-91af-42a7-b8ed-97580b24acfc on hv-cinder-83699 Jun 20 06:14:20.579385 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-62f15f1f-740a-4f1e-a475-aa3225e5da6e req-210825ed-7842-4e6f-b9c2-4829d87b6b90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033590 Jun 20 06:14:20.580610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 521/1019] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:14:20.613470 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:20.622015 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0a05a9cc-f920-4191-b860-9b7b1174fceb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.155981 Jun 20 06:14:20.622814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 499/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:20 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:20.905154 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aff163e-4c72-416c-8e1a-b20b723e7d8b"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:20.906327 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:20.912389 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.912833 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.913636 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.914072 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.398283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6e716084-8ea8-4e4d-ab1c-55f852f6683b tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "POST /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497317 Jun 20 06:14:21.398873 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 522/1021] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:14:20 2022] POST /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:21.639852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:21.640379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:21.647542 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.647992 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.648752 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.649216 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.783114 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:21.791378 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8b6896a3-6425-41a9-b616-8fe80e688065 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1266 microversion: 2.1 time: 0.155152 Jun 20 06:14:21.792021 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 500/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:21 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:22.810337 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:22.811148 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:22.817422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.817877 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.818631 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.819070 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.947883 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:22.955479 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-503e22b0-945d-45d6-9c5c-c3ff830fc6e7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1453 microversion: 2.1 time: 0.150076 Jun 20 06:14:22.956032 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 523/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:22 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:22.971779 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:22.972397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:22.979414 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.979874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.980643 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.981117 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.117287 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:23.125031 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c39d8713-f5ca-4826-8059-3b26938b1f62 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1453 microversion: 2.1 time: 0.157037 Jun 20 06:14:23.125590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 501/1024] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:22 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:24.733296 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-ac052375-f9e6-43d4-8374-3353cce03269 req-6fedcec3-aff4-4b33-860d-307957b1cef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bdac5a-91af-42a7-b8ed-97580b24acfc", "tag": "585d0ae7-33b2-4f09-aac0-a0ba4271f187"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:24.741488 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ac052375-f9e6-43d4-8374-3353cce03269 req-6fedcec3-aff4-4b33-860d-307957b1cef3 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.741938 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ac052375-f9e6-43d4-8374-3353cce03269 req-6fedcec3-aff4-4b33-860d-307957b1cef3 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.752767 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-ac052375-f9e6-43d4-8374-3353cce03269 req-6fedcec3-aff4-4b33-860d-307957b1cef3 service nova] Creating event network-changed:585d0ae7-33b2-4f09-aac0-a0ba4271f187 for instance 99bdac5a-91af-42a7-b8ed-97580b24acfc on hv-cinder-83699 Jun 20 06:14:24.758198 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-ac052375-f9e6-43d4-8374-3353cce03269 req-6fedcec3-aff4-4b33-860d-307957b1cef3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086442 Jun 20 06:14:24.758854 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 524/1025] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:28.975530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:28.976011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:28.982520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.982975 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.983763 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.984201 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.063721 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lazy-loading 'services' on Instance uuid 24c49a3f-a844-456a-85ea-9dd2653cf3ae {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:29.133711 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-783d171e-0c97-4bae-baae-61bc2fcc357f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments/8aff163e-4c72-416c-8e1a-b20b723e7d8b" status: 202 len: 0 microversion: 2.1 time: 0.161878 Jun 20 06:14:29.134377 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 502/1026] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:14:28 2022] DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments/8aff163e-4c72-416c-8e1a-b20b723e7d8b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:14:29.143846 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:29.144858 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:29.151163 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.151465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.152232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.152670 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.182275 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-874e6d17-1f42-45bd-9c38-cb952588751d tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043355 Jun 20 06:14:29.182867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 525/1027] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:14:29 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:30.194463 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:30.195463 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:30.201632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.202077 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.202836 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.203271 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.231260 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d217f51e-dbf1-48a4-aac6-9192191bc687 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041684 Jun 20 06:14:30.231820 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 503/1028] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:14:30 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:14:30.290774 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:30.291281 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:30.297743 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.298188 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.298938 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.299370 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.323825 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:14:30.394180 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e00f2393-8e2c-4537-b6ef-21cfcfb0d4d5 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 204 len: 0 microversion: 2.1 time: 0.107477 Jun 20 06:14:30.394749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 526/1029] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:30 2022] DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:14:30.402898 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:30.403506 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:30.409468 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.409911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.410660 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.411092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.540810 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:30.548134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-be1f4465-d5d5-42d8-a3f5-c1ddf4e1ae20 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1683 microversion: 2.1 time: 0.149068 Jun 20 06:14:30.548691 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 504/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:30 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:31.565899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:31.566600 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:31.573577 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.574030 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.574787 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.575222 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.701580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:31.709596 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5435d652-5dc1-4287-8d6a-0468c8717089 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1683 microversion: 2.1 time: 0.147923 Jun 20 06:14:31.710166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 527/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:31 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:32.727540 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:32.728292 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:32.735237 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.735779 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.736551 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.737049 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.868002 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:32.875765 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9a933c12-ceee-45e9-bcfb-8cd5d017ee35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1683 microversion: 2.1 time: 0.152828 Jun 20 06:14:32.876335 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 505/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:32 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:33.546808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-2101c41c-1199-4f4c-ab0d-ddcbe81f14af req-b4ac33cf-f999-4db1-aa85-5314baf632f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c49a3f-a844-456a-85ea-9dd2653cf3ae", "name": "network-vif-deleted", "tag": "b1734c76-38df-4944-8061-0ffe6e4d2b5e"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:33.556942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-2101c41c-1199-4f4c-ab0d-ddcbe81f14af req-b4ac33cf-f999-4db1-aa85-5314baf632f4 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.557544 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-2101c41c-1199-4f4c-ab0d-ddcbe81f14af req-b4ac33cf-f999-4db1-aa85-5314baf632f4 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.570560 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-2101c41c-1199-4f4c-ab0d-ddcbe81f14af req-b4ac33cf-f999-4db1-aa85-5314baf632f4 service nova] Creating event network-vif-deleted:b1734c76-38df-4944-8061-0ffe6e4d2b5e for instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae on hv-cinder-83699 Jun 20 06:14:33.575417 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-2101c41c-1199-4f4c-ab0d-ddcbe81f14af req-b4ac33cf-f999-4db1-aa85-5314baf632f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100077 Jun 20 06:14:33.576050 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 528/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:33.893428 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:33.894052 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:33.900464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.900911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.901710 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.902143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.936880 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.937666 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.938124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lazy-loading 'fault' on Instance uuid 24c49a3f-a844-456a-85ea-9dd2653cf3ae {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:33.983474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ed46e793334426bad6055e2085dacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f7b47f81a74868910102abb1d8a8e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:33.991859 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-50ea1acb-1ce9-48af-88e9-622f1e901c35 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 200 len: 1331 microversion: 2.1 time: 0.102733 Jun 20 06:14:33.992573 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 506/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:33 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:35.010190 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:35.010881 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:35.017100 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.017801 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.018553 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.018981 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.032283 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae HTTP/1.1 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:14:35.033915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:35.035664 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '24c49a3f-a844-456a-85ea-9dd2653cf3ae'} Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:35.037263 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:35.038862 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:35.040288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:35.040288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9693e8c4-ca68-4c0e-8564-1d4e03cde9f8 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 404 len: 111 microversion: 2.1 time: 0.029795 Jun 20 06:14:35.040288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 529/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:35 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:35.045993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a45c53fd-9c72-45ad-b319-57bc4a61bbac tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '.version_select at 0x7f9d37f87040>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:35.063186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a45c53fd-9c72-45ad-b319-57bc4a61bbac tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736142014" status: 202 len: 0 microversion: 2.1 time: 0.021232 Jun 20 06:14:35.063759 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 507/1036] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 20 06:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736142014 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:14:36.777594 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:36.778115 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:36.784439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.784892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.785682 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.786117 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.799441 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae HTTP/1.1 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:14:36.800951 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.803279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '24c49a3f-a844-456a-85ea-9dd2653cf3ae'} Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:36.804212 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.805832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.807425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:36.807425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-362d23a1-8f59-4c8e-8929-f9356dc927fc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 404 len: 111 microversion: 2.1 time: 0.028531 Jun 20 06:14:36.807425 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 530/1037] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:36 2022] DELETE /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:36.811250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:36.811909 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 24c49a3f-a844-456a-85ea-9dd2653cf3ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:36.818356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.818814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.819584 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.820025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.833199 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae HTTP/1.1 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:14:36.834824 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.836410 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '24c49a3f-a844-456a-85ea-9dd2653cf3ae'} Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:36.837285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. Jun 20 06:14:36.838548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:36.839670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 24c49a3f-a844-456a-85ea-9dd2653cf3ae could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:36.839670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4e674158-c209-4366-b299-32a3a18df8f6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae" status: 404 len: 111 microversion: 2.1 time: 0.028920 Jun 20 06:14:36.839670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 508/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:36 2022] GET /compute/v2.1/servers/24c49a3f-a844-456a-85ea-9dd2653cf3ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:37.970547 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:37.971113 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:37.978187 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.978638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.979395 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.979831 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.992707 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 HTTP/1.1 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:14:37.994241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:37.995860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': 'ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172'} Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:37.996829 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:37.998381 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:37.999826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:37.999826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-14e0211b-9651-43f0-a369-5a8a558dbb94 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 404 len: 111 microversion: 2.1 time: 0.028868 Jun 20 06:14:37.999826 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 531/1039] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:37 2022] DELETE /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:38.003930 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.004548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.010964 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.011415 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.012170 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.012605 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.015244 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.028554 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 HTTP/1.1 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:14:38.030116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:38.031782 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172'} Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:38.032611 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. Jun 20 06:14:38.034143 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.035456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:38.035456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-91098c44-3b88-41e9-8167-cd938b2293bc tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172" status: 404 len: 111 microversion: 2.1 time: 0.031437 Jun 20 06:14:38.035456 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 509/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:37 2022] GET /compute/v2.1/servers/ccccbbeb-5c63-4d01-8e1e-4ed21c0a9172 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:38.040798 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.041334 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.047310 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.047766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.048613 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.048960 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.062465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 HTTP/1.1 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:14:38.063996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.065647 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '541914cc-a90e-4ca3-b086-fd3860a01da0'} Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:38.066532 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.068031 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.069795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:38.069795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-088d4b10-9fa0-479e-b783-579c3bfc7d05 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 404 len: 111 microversion: 2.1 time: 0.028987 Jun 20 06:14:38.069795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 532/1041] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:38 2022] DELETE /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:38.073883 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.074498 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 541914cc-a90e-4ca3-b086-fd3860a01da0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.076312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.081685 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.082138 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.082900 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.083839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.098189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 HTTP/1.1 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:14:38.100366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.102160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '541914cc-a90e-4ca3-b086-fd3860a01da0'} Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:38.103713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. Jun 20 06:14:38.105379 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:38.106801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 541914cc-a90e-4ca3-b086-fd3860a01da0 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:38.106801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0da545b3-8eb7-457f-aafe-91cfb7f6df0a tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0" status: 404 len: 111 microversion: 2.1 time: 0.031787 Jun 20 06:14:38.106801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 510/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:38 2022] GET /compute/v2.1/servers/541914cc-a90e-4ca3-b086-fd3860a01da0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:39.280922 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:39.281461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:39.283812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:39.289053 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:39.289502 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.290249 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:39.290684 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.294023 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:39.306527 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d HTTP/1.1 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:14:39.308214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.309875 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '66d4998a-6c49-45ad-9768-8df93ecacb8d'} Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:39.310941 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.312467 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.314135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:39.314135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ea8dbdf6-a765-4559-a3d0-c7c3c7d1d05f tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 404 len: 111 microversion: 2.1 time: 0.032445 Jun 20 06:14:39.314135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 533/1043] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:39 2022] DELETE /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:39.318451 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:39.319067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] [instance: 66d4998a-6c49-45ad-9768-8df93ecacb8d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:39.325485 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:39.325935 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.326694 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:39.327129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.340792 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] HTTP exception thrown: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Request method failure captured: Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d HTTP/1.1 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA8kRlbG8dukXpNw4pFBNIiMe2ZdU_JJqncsN-vvxgdyN2FrlvTtOfpG11ZwR7HW5VO4c-VDhuLBsyt2e4ga_o9XSaFIT_31m8yyOdKaEdoX9uNHQtZFligzabCucRFBJqqQp_mZdWk0X7teA9F3TFNVRHBUOXocKfM8eXp8jyrBjI4 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:14:39.342314 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31f7b47f81a74868910102abb1d8a8e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31f7b47f81a74868910102abb1d8a8e0", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 31f7b47f81a74868910102abb1d8a8e0 Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294594702 Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 96ed46e793334426bad6055e2085dacf Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-1294594702-project Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.343924 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '66d4998a-6c49-45ad-9768-8df93ecacb8d'} Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:39.344938 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. Jun 20 06:14:39.346474 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:14:39.348133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] Returning 404 to user: Instance 66d4998a-6c49-45ad-9768-8df93ecacb8d could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:39.348133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-caffcfea-39db-48e7-a738-aab3f0a78ad6 tempest-AttachVolumeNegativeTest-1294594702 tempest-AttachVolumeNegativeTest-1294594702-project] 10.222.0.20 "GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d" status: 404 len: 111 microversion: 2.1 time: 0.029646 Jun 20 06:14:39.348133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 511/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:39 2022] GET /compute/v2.1/servers/66d4998a-6c49-45ad-9768-8df93ecacb8d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:56.815012 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-441997960", "imageRef": "df8942fc-263a-4cf3-bc50-dd2b2deb0f80", "flavorRef": "452"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:56.821133 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:56.865421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] validate_networks() for None {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:57.134781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:57.135239 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:57.135711 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:57.136153 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:57.136593 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:57.146461 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:57.146927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:57.147702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:57.148138 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:57.164824 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Getting quotas for project 01425a92a39b474cbd92798b8a33358e. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:57.168841 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Getting quotas for user f9f011b09d2549749481e6e6f6547a7b and project 01425a92a39b474cbd92798b8a33358e. Resources: {'ram', 'instances', 'cores'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:57.180641 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:57.182927 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df8942fc-263a-4cf3-bc50-dd2b2deb0f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:57.225182 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-36dd22b8-dae6-4720-b2fc-57f4c132feaa tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.414481 Jun 20 06:14:57.225812 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 534/1045] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:57.235610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a2071d08-5f92-4f12-ad17-c4dde2e27e85 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:57.236233 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a2071d08-5f92-4f12-ad17-c4dde2e27e85 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:57.238713 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:57.239349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=5 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:57.291769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a2071d08-5f92-4f12-ad17-c4dde2e27e85 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:57.298369 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a2071d08-5f92-4f12-ad17-c4dde2e27e85 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1214 microversion: 2.1 time: 0.066552 Jun 20 06:14:57.298925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 512/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:57 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:58.316561 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:58.317239 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:58.323806 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:58.324235 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:58.324996 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:58.325434 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:58.389282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:58.397245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-75bbf8f0-d96c-4b6b-81d8-c6ecabe4fbc2 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1274 microversion: 2.1 time: 0.085174 Jun 20 06:14:58.398033 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 535/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:58 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:59.414442 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:59.415062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:59.424116 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:59.424865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:59.425673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:59.426309 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:59.559383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:59.567020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-73a02012-1108-424e-ab8c-fe25b7158894 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1314 microversion: 2.1 time: 0.156583 Jun 20 06:14:59.568099 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 513/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:59 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:59.961944 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-24e7003c-9159-4671-a0a4-ad508263010c req-8af43339-2b59-4b22-824f-fd992de3a9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819ddbc5-b1e1-4a6c-ae60-28c17dba6c39", "tag": "06b8cf37-f26c-44ae-92fb-c915b2f39c88"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:59.971438 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-24e7003c-9159-4671-a0a4-ad508263010c req-8af43339-2b59-4b22-824f-fd992de3a9e0 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:59.972312 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-24e7003c-9159-4671-a0a4-ad508263010c req-8af43339-2b59-4b22-824f-fd992de3a9e0 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:59.988733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-24e7003c-9159-4671-a0a4-ad508263010c req-8af43339-2b59-4b22-824f-fd992de3a9e0 service nova] Creating event network-changed:06b8cf37-f26c-44ae-92fb-c915b2f39c88 for instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 on hv-cinder-83699 Jun 20 06:14:59.994555 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-24e7003c-9159-4671-a0a4-ad508263010c req-8af43339-2b59-4b22-824f-fd992de3a9e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036310 Jun 20 06:14:59.995313 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 536/1049] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:00.585018 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:00.585633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:00.592265 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:00.592714 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:00.593493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:00.593925 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:00.722003 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:00.729881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e987314f-781f-437c-8ff4-7a8712ce612f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1314 microversion: 2.1 time: 0.149303 Jun 20 06:15:00.730430 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 514/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:00 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:01.747302 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:01.747993 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:01.754148 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:01.754595 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:01.755858 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:01.756282 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:01.888099 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:01.895576 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8a3245d1-f3d8-4db5-a21b-f3fa9b236346 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1314 microversion: 2.1 time: 0.152964 Jun 20 06:15:01.896131 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 537/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:01 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:02.913160 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:02.913773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:02.920206 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:02.920656 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:02.921449 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:02.921885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:03.048633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:03.056397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-75f61ca6-e3c5-4b6e-8dd2-b4b50d143a90 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1314 microversion: 2.1 time: 0.147726 Jun 20 06:15:03.056969 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 515/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:02 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:04.074646 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:04.075264 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:04.081716 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:04.082166 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:04.082918 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:04.084026 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:04.212807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:04.220003 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-81952e1f-dc6f-44cb-9dc1-ec455b4f43f7 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1314 microversion: 2.1 time: 0.150000 Jun 20 06:15:04.220552 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 538/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:04 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:04.899828 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-3c46b084-9146-4e99-acf0-eac92309a8ac req-8755b7d5-6e58-4e97-86b5-2e214fcaf32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ddbc5-b1e1-4a6c-ae60-28c17dba6c39", "name": "network-vif-plugged", "status": "completed", "tag": "06b8cf37-f26c-44ae-92fb-c915b2f39c88"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:04.907918 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-3c46b084-9146-4e99-acf0-eac92309a8ac req-8755b7d5-6e58-4e97-86b5-2e214fcaf32e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:04.908366 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-3c46b084-9146-4e99-acf0-eac92309a8ac req-8755b7d5-6e58-4e97-86b5-2e214fcaf32e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:04.919353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-3c46b084-9146-4e99-acf0-eac92309a8ac req-8755b7d5-6e58-4e97-86b5-2e214fcaf32e service nova] Creating event network-vif-plugged:06b8cf37-f26c-44ae-92fb-c915b2f39c88 for instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 on hv-cinder-83699 Jun 20 06:15:04.924267 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-3c46b084-9146-4e99-acf0-eac92309a8ac req-8755b7d5-6e58-4e97-86b5-2e214fcaf32e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152397 Jun 20 06:15:04.924843 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 516/1054] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:05.236800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:05.237445 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:05.243872 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:05.244322 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:05.245116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:05.245552 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:05.369992 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:05.377279 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3b5f8c71-2a31-4d65-ac22-9d597e770efe tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1314 microversion: 2.1 time: 0.144274 Jun 20 06:15:05.377838 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 539/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:05 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:06.395870 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:06.396482 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:06.402738 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:06.403189 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:06.403946 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:06.404383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:06.531004 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:06.538432 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7192cbb9-845e-44b9-981b-dff611249256 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1464 microversion: 2.1 time: 0.147650 Jun 20 06:15:06.538990 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 517/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:06 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:06.578489 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:06.578974 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:06.585347 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:06.585805 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:06.586569 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:06.587011 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:06.610800 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:15:06.684001 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d00ff5f3-cfef-4698-9e6f-829063632453 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 204 len: 0 microversion: 2.1 time: 0.108919 Jun 20 06:15:06.684501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 540/1057] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:15:06 2022] DELETE /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:15:06.694205 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:06.694839 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:06.701349 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:06.701801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:06.702565 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:06.703001 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:06.843330 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:06.851399 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-50950ef5-5dab-4bb9-9a57-fff0d03716df tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1470 microversion: 2.1 time: 0.162664 Jun 20 06:15:06.851949 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 518/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:06 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:07.869542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:07.870245 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:07.872308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:07.873042 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:07.879868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:07.880900 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:07.881702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:07.882142 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:08.009295 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:08.016676 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dde5d3a2-9379-4f4a-91a1-30a5a4ddee1f tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1470 microversion: 2.1 time: 0.151891 Jun 20 06:15:08.017280 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 541/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:07 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:08.811401 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-da0b82a5-f39c-4782-ad8a-e73343890127 req-7c7facb6-d2c3-4d0b-b910-d08fdbb78f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ddbc5-b1e1-4a6c-ae60-28c17dba6c39", "name": "network-vif-deleted", "tag": "06b8cf37-f26c-44ae-92fb-c915b2f39c88"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:08.815321 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:08.824464 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-da0b82a5-f39c-4782-ad8a-e73343890127 req-7c7facb6-d2c3-4d0b-b910-d08fdbb78f1b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:08.825220 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-da0b82a5-f39c-4782-ad8a-e73343890127 req-7c7facb6-d2c3-4d0b-b910-d08fdbb78f1b service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:08.837865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-da0b82a5-f39c-4782-ad8a-e73343890127 req-7c7facb6-d2c3-4d0b-b910-d08fdbb78f1b service nova] Creating event network-vif-deleted:06b8cf37-f26c-44ae-92fb-c915b2f39c88 for instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 on hv-cinder-83699 Jun 20 06:15:08.843223 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-da0b82a5-f39c-4782-ad8a-e73343890127 req-7c7facb6-d2c3-4d0b-b910-d08fdbb78f1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035429 Jun 20 06:15:08.844020 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 519/1060] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:09.033514 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:09.034128 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:09.040609 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:09.041096 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:09.041860 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:09.042295 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:09.072957 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:09.073441 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:09.073892 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lazy-loading 'fault' on Instance uuid 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:15:09.118957 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f011b09d2549749481e6e6f6547a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01425a92a39b474cbd92798b8a33358e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:09.126308 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e21a617b-6daa-4968-8b81-48e7e5d7e9ef tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 200 len: 1304 microversion: 2.1 time: 0.096649 Jun 20 06:15:09.126867 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 542/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:09 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:10.145063 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:10.146285 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] [instance: 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:10.152586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.153072 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.153834 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.154270 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.167953 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] HTTP exception thrown: Instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 could not be found. Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Request method failure captured: Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 HTTP/1.1 Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisBBfo9QeYEU6aRxK8Pv-0c8hkYflQsWoy_r9u4EFwR1NSvrpxMHcljnrES8zw7zz_u4XT8ZsYY10thSZgQWfRJwArTg3jH2ir8SUDFI4N0e36HDeDMFzWEnfpH8vBsMV2yZvutZjUTHHRXScdztLyC5m0HaEdYqQBUYzpMyiv93UwQ0 Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 01425a92a39b474cbd92798b8a33358e Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesNegativeTest-722655750 Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:15:10.169587 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01425a92a39b474cbd92798b8a33358e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01425a92a39b474cbd92798b8a33358e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01425a92a39b474cbd92798b8a33358e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01425a92a39b474cbd92798b8a33358e", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesNegativeTest-722655750 Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 01425a92a39b474cbd92798b8a33358e Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesNegativeTest-722655750 Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesNegativeTest-722655750-project Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: f9f011b09d2549749481e6e6f6547a7b Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesNegativeTest-722655750-project Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 could not be found. Jun 20 06:15:10.171342 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '819ddbc5-b1e1-4a6c-ae60-28c17dba6c39'} Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 could not be found. Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:15:10.172536 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 could not be found. Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 could not be found. Jun 20 06:15:10.174172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:15:10.176358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] Returning 404 to user: Instance 819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:15:10.176358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-528533c9-371b-4d43-bbff-b99a010483d8 tempest-VolumesNegativeTest-722655750 tempest-VolumesNegativeTest-722655750-project] 10.222.0.20 "GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39" status: 404 len: 111 microversion: 2.1 time: 0.031057 Jun 20 06:15:10.176358 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 520/1062] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:10 2022] GET /compute/v2.1/servers/819ddbc5-b1e1-4a6c-ae60-28c17dba6c39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:33.073983 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-38ab0ae9-33be-412c-a57b-c3d120a0530d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Action: 'create', calling method: .version_select at 0x7f9d489f49d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-147250979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH431Bze4pr3GAPQ8ghkVF3mVmgjjJKttA3VMZCra1Xv63yRIpH+tt/RcZWN8fIoV/EhSTYJgj96wBoCUjM2dWQ7Owhyo5ThIZYsqGUiQNC5b/dDrT5VSu4snIiHgm9/aQ=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:33.078480 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:33.079180 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:33.094943 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-38ab0ae9-33be-412c-a57b-c3d120a0530d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Getting quotas for project de6d1de1afba411cbc3593372102768c. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:33.098697 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-38ab0ae9-33be-412c-a57b-c3d120a0530d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Getting quotas for user cf5d1fe915c6487a8f5e803c6ed8adeb and project de6d1de1afba411cbc3593372102768c. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:33.119763 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-38ab0ae9-33be-412c-a57b-c3d120a0530d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053872 Jun 20 06:15:33.120342 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 543/1063] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 20 06:15:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:15:33.167690 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1749788352", "imageRef": "5785be34-3910-43ff-85a7-9d29c2a4720d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-147250979", "networks": [{"uuid": "fcc0f99b-be0a-4c96-864c-22e379e8b7f9"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:33.174890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=20 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:33.175530 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=36 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:33.220305 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] validate_networks() for [('fcc0f99b-be0a-4c96-864c-22e379e8b7f9', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:15:33.674166 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:15:33.674613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:15:33.675092 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:15:33.675502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:15:33.675917 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:15:33.684794 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:33.685273 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:33.686067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:33.686503 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:33.702769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Getting quotas for project de6d1de1afba411cbc3593372102768c. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:33.706714 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Getting quotas for user cf5d1fe915c6487a8f5e803c6ed8adeb and project de6d1de1afba411cbc3593372102768c. Resources: {'ram', 'instances', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:33.717878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:15:33.720030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5785be34-3910-43ff-85a7-9d29c2a4720d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:15:33.764993 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-679ca245-e6cc-4fc6-86a3-f99f4596c373 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601105 Jun 20 06:15:33.765640 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 521/1064] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 20 06:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:15:33.776189 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9a2ab683-8115-4b16-9e30-c4169296dc96 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:33.776970 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9a2ab683-8115-4b16-9e30-c4169296dc96 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:34.086083 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9a2ab683-8115-4b16-9e30-c4169296dc96 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:34.095049 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9a2ab683-8115-4b16-9e30-c4169296dc96 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1258 microversion: 2.1 time: 0.322646 Jun 20 06:15:34.095618 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 544/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:33 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1258 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:35.111952 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:35.112682 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:35.118974 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.119505 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.120287 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.120732 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.186249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:35.194183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3ebacd1c-1075-42ea-a790-1a5b2a17602f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1316 microversion: 2.1 time: 0.086437 Jun 20 06:15:35.194836 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 522/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:35 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:36.211632 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:36.212251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:36.219447 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.219905 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.220679 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.221152 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.364928 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:36.373025 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9bffa417-5e21-459e-abb5-bddd6772bf5d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.165134 Jun 20 06:15:36.373626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 545/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:36 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:37.391815 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:37.392582 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:37.399670 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.400124 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.400885 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.401361 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.558372 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:37.566328 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-759a7680-26f6-4583-8969-a922dacfe424 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.179646 Jun 20 06:15:37.566985 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 523/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:37 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:38.584159 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:38.584796 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:38.591197 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.591643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.592392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.592816 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.732527 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:38.770542 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9716b67b-796d-4d3d-ad56-fa7464708927 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.190312 Jun 20 06:15:38.774345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 546/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:38 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:39.789017 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:39.789659 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:39.796890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.797393 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.798192 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.798625 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.943730 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:39.949488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cee2922c-531d-4f8d-8d07-20b2347580d5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.164359 Jun 20 06:15:39.950062 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 524/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:39 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:40.980866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:40.982781 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:40.995109 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.995571 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.996353 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.996791 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:41.135884 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:41.143958 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8a9d6c6c-0791-4634-9f5a-d513aa5d3645 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.174371 Jun 20 06:15:41.147719 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 547/1071] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:40 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:42.162770 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:42.163426 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:42.170403 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.170865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.171646 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.172087 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.308409 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:42.315796 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-34fa6328-1fda-4249-9478-0ef089ac76e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.157051 Jun 20 06:15:42.316493 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 525/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:42 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:43.333888 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:43.334573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:43.341746 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.342302 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.343167 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.343705 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.455689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-642a1ad5-0fec-4092-972a-2651b80cef3c req-b87e5dbf-8a43-484c-863d-dba7175df049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:43.481773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-642a1ad5-0fec-4092-972a-2651b80cef3c req-b87e5dbf-8a43-484c-863d-dba7175df049 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.482162 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-642a1ad5-0fec-4092-972a-2651b80cef3c req-b87e5dbf-8a43-484c-863d-dba7175df049 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.488384 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:43.495937 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-57bda2ac-2a52-4d46-b71b-7fa2c605854b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.166587 Jun 20 06:15:43.496771 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 548/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:43 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:43.508967 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-642a1ad5-0fec-4092-972a-2651b80cef3c req-b87e5dbf-8a43-484c-863d-dba7175df049 service nova] Creating event network-changed:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:15:43.514123 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-642a1ad5-0fec-4092-972a-2651b80cef3c req-b87e5dbf-8a43-484c-863d-dba7175df049 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065436 Jun 20 06:15:43.514741 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 526/1074] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:15:44.514117 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:44.514739 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:44.516565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:44.523019 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.523465 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.524226 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.524659 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.648706 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:44.655978 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4466cfd7-a176-4b88-8c6d-f3b501db05f8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.145772 Jun 20 06:15:44.656541 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 549/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:44 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:45.669760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:45.670541 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:45.675023 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:45.675729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:45.683129 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:45.683579 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.684337 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:45.684775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.815881 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:45.823302 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-be6af1c9-6c50-4623-ad55-b30a15e490c1 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.154496 Jun 20 06:15:45.823865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 527/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:45 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:46.839952 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:46.840558 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:46.847081 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.847534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.848290 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.848727 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.975220 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:46.982693 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-678d3016-d141-4f9c-aac3-ff68ca350940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.146525 Jun 20 06:15:46.983253 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 550/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:46 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:47.999891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:48.000501 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:48.007539 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.007987 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.008734 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.009213 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.140613 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:48.151866 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e2fd1b07-7f27-486f-bcb8-f95320ce412f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.155910 Jun 20 06:15:48.152425 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 528/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:47 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:49.037789 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-513a5915-d118-4a4c-976a-9c21e87cd0cb req-a7d1bae3-a992-4ede-8b04-520745bf1049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "name": "network-vif-plugged", "status": "completed", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:49.046729 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-513a5915-d118-4a4c-976a-9c21e87cd0cb req-a7d1bae3-a992-4ede-8b04-520745bf1049 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.047092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-513a5915-d118-4a4c-976a-9c21e87cd0cb req-a7d1bae3-a992-4ede-8b04-520745bf1049 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.060249 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-513a5915-d118-4a4c-976a-9c21e87cd0cb req-a7d1bae3-a992-4ede-8b04-520745bf1049 service nova] Creating event network-vif-plugged:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:15:49.065421 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-513a5915-d118-4a4c-976a-9c21e87cd0cb req-a7d1bae3-a992-4ede-8b04-520745bf1049 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Jun 20 06:15:49.066024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 551/1079] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:49.168790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:49.169466 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:49.175941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.176320 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.177172 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.177604 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.309397 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.316877 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6f1e1faa-65fb-4e1e-9506-b24709da5cc6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.152524 Jun 20 06:15:49.317548 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 529/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:49 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:50.335392 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:50.336036 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:50.342194 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.342642 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.343386 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.343813 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.474102 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:50.484820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3701a32e-8bb6-4d01-b785-534e7fde6722 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1358 microversion: 2.1 time: 0.153886 Jun 20 06:15:50.486307 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 552/1081] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:50 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:51.503350 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.503962 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:51.510592 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.511038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.511790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.512218 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.640084 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.648304 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e5ad8114-9f0f-442a-b106-5ebdf7aebee7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1548 microversion: 2.1 time: 0.148896 Jun 20 06:15:51.648869 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 530/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:51.664678 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.665313 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:51.671572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.672020 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.672769 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.673231 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.797638 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.805211 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-312ece44-57ea-47f6-8cab-d0a7a1fb6678 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1548 microversion: 2.1 time: 0.144793 Jun 20 06:15:51.805769 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 553/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:51.821217 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.824633 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.825436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Searching by: {'deleted': False, 'project_id': 'de6d1de1afba411cbc3593372102768c'} {{(pid=117665) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 06:15:51.831891 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.832343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.833158 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.833594 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.926025 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.multi_cell_list [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117665) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 06:15:52.020083 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-456ca75f-93f6-432e-bbcf-1334a96d1107 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202841 Jun 20 06:15:52.020667 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 531/1084] 10.222.0.20 () {58 vars in 1124 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:52.031615 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:52.032249 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:52.038160 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.038616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.039378 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.039819 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.167755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.175251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-007d387c-bb56-4b1b-8c59-683633e74e1c tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1548 microversion: 2.1 time: 0.147456 Jun 20 06:15:52.175756 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 554/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:52 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:53.669654 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0c437e5-f8b1-4c53-a3f7-e797c5859d46"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:53.670719 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:53.677418 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.677865 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.678742 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.679178 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.949732 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a8caa163-13c1-4060-973c-a9c469aca04d tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283756 Jun 20 06:15:53.950501 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 532/1086] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 20 06:15:53 2022] POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:55.127175 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-3c7ed2ad-97fd-4233-84ba-e7be69b4807f req-c6334991-4e48-4aeb-9acc-32a763c2e8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bdac5a-91af-42a7-b8ed-97580b24acfc", "tag": "585d0ae7-33b2-4f09-aac0-a0ba4271f187"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:55.134074 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:55.135177 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:55.136133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-3c7ed2ad-97fd-4233-84ba-e7be69b4807f req-c6334991-4e48-4aeb-9acc-32a763c2e8c4 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.136652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-3c7ed2ad-97fd-4233-84ba-e7be69b4807f req-c6334991-4e48-4aeb-9acc-32a763c2e8c4 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.141819 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.142594 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.143364 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.143795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.152652 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-3c7ed2ad-97fd-4233-84ba-e7be69b4807f req-c6334991-4e48-4aeb-9acc-32a763c2e8c4 service nova] Creating event network-changed:585d0ae7-33b2-4f09-aac0-a0ba4271f187 for instance 99bdac5a-91af-42a7-b8ed-97580b24acfc on hv-cinder-83699 Jun 20 06:15:55.157703 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-3c7ed2ad-97fd-4233-84ba-e7be69b4807f req-c6334991-4e48-4aeb-9acc-32a763c2e8c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034881 Jun 20 06:15:55.158388 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 533/1087] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:55.170910 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:15:55.252396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bab02560-d613-4196-bdb9-b439828d95ae tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 204 len: 0 microversion: 2.1 time: 0.132646 Jun 20 06:15:55.253486 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 555/1088] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:15:55 2022] DELETE /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:15:55.263137 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:55.263851 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:55.271666 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.272127 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.272911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.273923 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.405893 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.413519 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ed0da94c-6517-421c-8335-ee48b5c0b102 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1577 microversion: 2.1 time: 0.155090 Jun 20 06:15:55.414168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 534/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:55 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:56.431733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.432358 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.438994 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.439441 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.440192 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.440625 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.574419 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.581858 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fb09e2dc-269f-42c3-84b5-875b55b0bb72 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1577 microversion: 2.1 time: 0.154524 Jun 20 06:15:56.582420 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 556/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:56 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:57.599562 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:57.600168 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:57.606775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.607226 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.607983 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.608416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.821424 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.828806 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-89fd3d2c-29de-4c25-9497-652368e6cc59 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1577 microversion: 2.1 time: 0.233090 Jun 20 06:15:57.829419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 535/1091] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:57 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:58.124475 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-332ce972-65b5-47b9-9d88-19abf4c93765 req-cff2aeb7-1001-4ae9-affe-02032c8d93d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bdac5a-91af-42a7-b8ed-97580b24acfc", "name": "network-vif-deleted", "tag": "585d0ae7-33b2-4f09-aac0-a0ba4271f187"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:58.135515 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-332ce972-65b5-47b9-9d88-19abf4c93765 req-cff2aeb7-1001-4ae9-affe-02032c8d93d6 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.135963 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-332ce972-65b5-47b9-9d88-19abf4c93765 req-cff2aeb7-1001-4ae9-affe-02032c8d93d6 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.147793 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-332ce972-65b5-47b9-9d88-19abf4c93765 req-cff2aeb7-1001-4ae9-affe-02032c8d93d6 service nova] Creating event network-vif-deleted:585d0ae7-33b2-4f09-aac0-a0ba4271f187 for instance 99bdac5a-91af-42a7-b8ed-97580b24acfc on hv-cinder-83699 Jun 20 06:15:58.153579 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-332ce972-65b5-47b9-9d88-19abf4c93765 req-cff2aeb7-1001-4ae9-affe-02032c8d93d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Jun 20 06:15:58.154426 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 557/1092] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:58.845729 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:58.846321 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:58.853301 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.853745 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.854497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.854926 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.886521 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.886966 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.887412 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lazy-loading 'fault' on Instance uuid 99bdac5a-91af-42a7-b8ed-97580b24acfc {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:15:58.929817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.937980 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-76721423-1df3-45b1-a0d2-e8a7b3a03297 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 200 len: 1230 microversion: 2.1 time: 0.096038 Jun 20 06:15:58.938549 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 536/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:58 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:59.956539 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.957268 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 99bdac5a-91af-42a7-b8ed-97580b24acfc] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.963745 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.964250 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.965008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.965481 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.979009 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] HTTP exception thrown: Instance 99bdac5a-91af-42a7-b8ed-97580b24acfc could not be found. Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Request method failure captured: Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc HTTP/1.1 Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA75ezrxRIDRsoGrApHBF-nPRbFhhcGt4EA8A6Gc2bKayDzc0Eq_E59pvg7GQxg5Yujrlbgijzlmnt8p36Ts4sdl1ujtnzT_3Yytib8sN_1n8x2goyYKBdEGK4f0gRWh8hVO4o_IAHxcwgrrEsJOl1jiOVrdtRwDAr_fv37q2ZQ8INA Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:15:59.980608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_888311b555bb436ca9bc99aed66458d5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-TestVolumeBootPattern-857602549 Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 8a4b39d3a27c4077b88cd0802a240b53 Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 99bdac5a-91af-42a7-b8ed-97580b24acfc could not be found. Jun 20 06:15:59.982398 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '99bdac5a-91af-42a7-b8ed-97580b24acfc'} Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bdac5a-91af-42a7-b8ed-97580b24acfc could not be found. Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:15:59.983380 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bdac5a-91af-42a7-b8ed-97580b24acfc could not be found. Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bdac5a-91af-42a7-b8ed-97580b24acfc could not be found. Jun 20 06:15:59.985071 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:15:59.986518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Returning 404 to user: Instance 99bdac5a-91af-42a7-b8ed-97580b24acfc could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:15:59.986518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c12fba9d-132a-46fd-a93b-4ec7736e94d7 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc" status: 404 len: 111 microversion: 2.1 time: 0.030165 Jun 20 06:15:59.986518 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 558/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/99bdac5a-91af-42a7-b8ed-97580b24acfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:01.490981 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:01.491978 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:01.500188 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.500640 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.501438 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.501898 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.521176 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:01.634769 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:01.642590 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3c961d1c-eddc-49ec-a667-8527e62c3b78 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1594 microversion: 2.1 time: 0.155611 Jun 20 06:16:01.643158 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 537/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:01 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:03.043804 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.044353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-d01f262b-8f0c-463b-8c19-b0366286dfa3 req-251b3080-1d23-4346-a862-ea37413db226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a6dca5-89dd-405d-8015-62e8cbcf08ac", "tag": "abd12247-83f5-467d-9fbd-501eb1f1c0e7"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:03.045422 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.054472 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.054683 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.055276 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.056343 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.056939 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.058307 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d01f262b-8f0c-463b-8c19-b0366286dfa3 req-251b3080-1d23-4346-a862-ea37413db226 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.058856 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d01f262b-8f0c-463b-8c19-b0366286dfa3 req-251b3080-1d23-4346-a862-ea37413db226 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.084602 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-d01f262b-8f0c-463b-8c19-b0366286dfa3 req-251b3080-1d23-4346-a862-ea37413db226 service nova] Creating event network-changed:abd12247-83f5-467d-9fbd-501eb1f1c0e7 for instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac on hv-cinder-83699 Jun 20 06:16:03.090801 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-d01f262b-8f0c-463b-8c19-b0366286dfa3 req-251b3080-1d23-4346-a862-ea37413db226 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050722 Jun 20 06:16:03.092067 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 538/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:03.097620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.106224 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:16:03.185643 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.208400 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c8fce5bb-a7ca-4e8c-a198-e1eafffa7b17 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 204 len: 0 microversion: 2.1 time: 0.168919 Jun 20 06:16:03.213744 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 559/1097] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:16:03 2022] DELETE /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:16:03.220242 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.221100 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.228159 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.231343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.232271 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.233610 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.235055 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.368613 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-f88bf4d3-e46c-43a9-9fd5-ed1b9280ac83 req-d225966a-3600-4a5d-bf47-39c914b8191e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:03.382232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f88bf4d3-e46c-43a9-9fd5-ed1b9280ac83 req-d225966a-3600-4a5d-bf47-39c914b8191e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.382828 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f88bf4d3-e46c-43a9-9fd5-ed1b9280ac83 req-d225966a-3600-4a5d-bf47-39c914b8191e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.402410 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-f88bf4d3-e46c-43a9-9fd5-ed1b9280ac83 req-d225966a-3600-4a5d-bf47-39c914b8191e service nova] Creating event network-changed:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:16:03.409200 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-f88bf4d3-e46c-43a9-9fd5-ed1b9280ac83 req-d225966a-3600-4a5d-bf47-39c914b8191e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045193 Jun 20 06:16:03.410246 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 560/1098] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:03.475830 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.486161 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9fd7c277-d7de-42dd-8799-74e7c35cdbbb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1579 microversion: 2.1 time: 0.270986 Jun 20 06:16:03.497775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 539/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:03 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1579 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:04.370868 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2111618210"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:04.371564 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.377766 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.378219 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.379165 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.379608 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.504502 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:04.506669 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.513702 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.514356 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.515147 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.517797 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.543660 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.network.security_group_api [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Adding security group 3291a9a1-8a19-4108-a8d9-71e0a0775f61 to port 59aeb35c-b619-4c08-b4b1-74464ac0fb52 Jun 20 06:16:04.839436 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.847249 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-efef7c3c-db26-445e-bc62-dc26b84783db tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1579 microversion: 2.1 time: 0.346560 Jun 20 06:16:04.848173 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 540/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:04 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1579 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:05.187755 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b289c21b-44b5-4b5c-995f-8c8e4f59c4b7 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/action" status: 202 len: 0 microversion: 2.1 time: 0.821797 Jun 20 06:16:05.189466 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 561/1101] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:04 2022] POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:05.198250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.198868 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.215950 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.216413 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.217236 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.217679 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.478652 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-b4232150-90a2-4793-8ba9-f9740bbf0f0d req-37ab83fe-fe26-48cd-b096-62ca7e6458d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:05.488161 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b4232150-90a2-4793-8ba9-f9740bbf0f0d req-37ab83fe-fe26-48cd-b096-62ca7e6458d1 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.488898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b4232150-90a2-4793-8ba9-f9740bbf0f0d req-37ab83fe-fe26-48cd-b096-62ca7e6458d1 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.501296 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-b4232150-90a2-4793-8ba9-f9740bbf0f0d req-37ab83fe-fe26-48cd-b096-62ca7e6458d1 service nova] Creating event network-changed:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:16:05.507028 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-b4232150-90a2-4793-8ba9-f9740bbf0f0d req-37ab83fe-fe26-48cd-b096-62ca7e6458d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033640 Jun 20 06:16:05.508024 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 562/1102] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:05.866379 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.870089 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.876702 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.877201 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.878008 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.878506 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.993207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.001947 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4eb869fa-e9c9-4d02-b787-ff5ff959a948 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1641 microversion: 2.1 time: 0.808084 Jun 20 06:16:06.002526 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 541/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1641 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:06.128849 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b39d3a27c4077b88cd0802a240b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888311b555bb436ca9bc99aed66458d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.138408 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9689e762-d8f8-418f-97f8-4334cc7244bb tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 200 len: 1579 microversion: 2.1 time: 0.276412 Jun 20 06:16:06.138977 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 563/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 1579 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:07.156758 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:07.157455 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: f9a6dca5-89dd-405d-8015-62e8cbcf08ac] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:07.163762 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.164207 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.165492 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.165919 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.179003 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] HTTP exception thrown: Instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac could not be found. Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Request method failure captured: Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac HTTP/1.1 Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA75ezrxRIDRsoGrApHBF-nPRbFhhcGt4EA8A6Gc2bKayDzc0Eq_E59pvg7GQxg5Yujrlbgijzlmnt8p36Ts4sdl1ujtnzT_3Yytib8sN_1n8x2goyYKBdEGK4f0gRWh8hVO4o_IAHxcwgrrEsJOl1jiOVrdtRwDAr_fv37q2ZQ8INA Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:16:07.181325 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_888311b555bb436ca9bc99aed66458d5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 8a4b39d3a27c4077b88cd0802a240b53 Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac could not be found. Jun 20 06:16:07.183027 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': 'f9a6dca5-89dd-405d-8015-62e8cbcf08ac'} Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac could not be found. Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:16:07.183878 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac could not be found. Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac could not be found. Jun 20 06:16:07.185290 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.186477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Returning 404 to user: Instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:16:07.186477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d47d9ebb-062d-44aa-bdfb-fe8953e610ea tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac" status: 404 len: 111 microversion: 2.1 time: 0.029770 Jun 20 06:16:07.186477 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 542/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:07 2022] GET /compute/v2.1/servers/f9a6dca5-89dd-405d-8015-62e8cbcf08ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:07.536075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-23e40fbf-b7e9-45bb-a787-184ba0262bb1 req-b3c31b7a-08e6-4d68-94c4-3d577942050e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a6dca5-89dd-405d-8015-62e8cbcf08ac", "name": "network-vif-deleted", "tag": "abd12247-83f5-467d-9fbd-501eb1f1c0e7"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:07.545523 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-23e40fbf-b7e9-45bb-a787-184ba0262bb1 req-b3c31b7a-08e6-4d68-94c4-3d577942050e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.545911 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-23e40fbf-b7e9-45bb-a787-184ba0262bb1 req-b3c31b7a-08e6-4d68-94c4-3d577942050e service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.557029 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-23e40fbf-b7e9-45bb-a787-184ba0262bb1 req-b3c31b7a-08e6-4d68-94c4-3d577942050e service nova] Creating event network-vif-deleted:abd12247-83f5-467d-9fbd-501eb1f1c0e7 for instance f9a6dca5-89dd-405d-8015-62e8cbcf08ac on hv-cinder-83699 Jun 20 06:16:07.561942 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-23e40fbf-b7e9-45bb-a787-184ba0262bb1 req-b3c31b7a-08e6-4d68-94c4-3d577942050e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029483 Jun 20 06:16:07.562738 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 564/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:07.613447 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:07.613922 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:07.619864 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.620312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.621090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.621520 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.634855 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] HTTP exception thrown: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Request method failure captured: Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b HTTP/1.1 Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisA75ezrxRIDRsoGrApHBF-nPRbFhhcGt4EA8A6Gc2bKayDzc0Eq_E59pvg7GQxg5Yujrlbgijzlmnt8p36Ts4sdl1ujtnzT_3Yytib8sN_1n8x2goyYKBdEGK4f0gRWh8hVO4o_IAHxcwgrrEsJOl1jiOVrdtRwDAr_fv37q2ZQ8INA Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:16:07.636353 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_888311b555bb436ca9bc99aed66458d5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: 8a4b39d3a27c4077b88cd0802a240b53 Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.638011 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '39cb3098-0dae-49b3-b980-6c5aec56db4b'} Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:16:07.638911 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.640404 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.642269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Returning 404 to user: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:16:07.642269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-af3140c0-1ed0-4e0f-be67-a8aceb4dc5b5 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 404 len: 111 microversion: 2.1 time: 0.028169 Jun 20 06:16:07.642269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 543/1107] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:16:07 2022] DELETE /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:07.646964 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:07.647673 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] [instance: 39cb3098-0dae-49b3-b980-6c5aec56db4b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:07.661624 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.662079 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.662909 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.663345 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.676412 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] HTTP exception thrown: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Request method failure captured: Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b HTTP/1.1 Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept: application/json Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Connection: close Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Length: 0 Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Content-Type: application/json Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Host: 10.222.0.20 Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.9 Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABisA75ezrxRIDRsoGrApHBF-nPRbFhhcGt4EA8A6Gc2bKayDzc0Eq_E59pvg7GQxg5Yujrlbgijzlmnt8p36Ts4sdl1ujtnzT_3Yytib8sN_1n8x2goyYKBdEGK4f0gRWh8hVO4o_IAHxcwgrrEsJOl1jiOVrdtRwDAr_fv37q2ZQ8INA Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Role: reader,member Jun 20 06:16:07.678149 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Roles: reader,member Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/888311b555bb436ca9bc99aed66458d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_888311b555bb436ca9bc99aed66458d5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 888311b555bb436ca9bc99aed66458d5 Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-TestVolumeBootPattern-857602549 Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Id: 8a4b39d3a27c4077b88cd0802a240b53 Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-TestVolumeBootPattern-857602549-project Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: method: > Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: exception: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.679779 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: action_args: {'id': '39cb3098-0dae-49b3-b980-6c5aec56db4b'} Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:16:07.681010 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. Jun 20 06:16:07.682565 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Jun 20 06:16:07.684037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Returning 404 to user: Instance 39cb3098-0dae-49b3-b980-6c5aec56db4b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:16:07.684037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ccc14d55-3049-4c43-9f77-54890a668c63 tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b" status: 404 len: 111 microversion: 2.1 time: 0.037029 Jun 20 06:16:07.684037 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 565/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:07 2022] GET /compute/v2.1/servers/39cb3098-0dae-49b3-b980-6c5aec56db4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:08.958703 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9f0ac383-d083-42d2-9952-dc99915653df tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] Calling method '.version_select at 0x7f9d4428dca0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:08.977182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9f0ac383-d083-42d2-9952-dc99915653df tempest-TestVolumeBootPattern-857602549 tempest-TestVolumeBootPattern-857602549-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-724460958" status: 202 len: 0 microversion: 2.1 time: 0.022241 Jun 20 06:16:08.977786 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 544/1109] 10.222.0.20 () {58 vars in 1259 bytes} [Mon Jun 20 06:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-724460958 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:28.516618 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:28.517583 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:28.519883 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:28.520803 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:28.526439 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.526906 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.527644 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.528075 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.598573 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6880d53a-5cc5-4f7b-9f59-9b4f1bcc5402 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/action" status: 202 len: 0 microversion: 2.1 time: 0.085414 Jun 20 06:16:28.599675 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 566/1110] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:28 2022] POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:28.605638 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=26 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:28.606386 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:28.610394 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:28.611000 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:28.618743 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.619289 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.620746 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.621197 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.859775 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.867826 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-212fbe86-8c1b-4ee2-b15b-08253b9c446e tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1751 microversion: 2.1 time: 0.264083 Jun 20 06:16:28.868391 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 545/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:28 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:29.887519 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:29.888214 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:29.894786 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.895227 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.896240 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.896667 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.037627 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:30.045352 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b768c526-cab9-41ae-945e-547f5b7376ab tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.162625 Jun 20 06:16:30.045915 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 567/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:29 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:31.062760 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:31.063833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:31.069835 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:31.070292 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.071073 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:31.071510 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.215019 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:31.222852 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c9267cd6-ff7a-4b8c-876a-f8c249d470e9 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.163917 Jun 20 06:16:31.223443 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 546/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:31 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:32.239620 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:32.240167 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:32.247429 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:32.247897 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:32.248681 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:32.249148 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:32.387203 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:32.394967 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cb55c667-e272-4c1e-96df-629d3bd908d6 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.159281 Jun 20 06:16:32.395775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 568/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:32 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:33.412185 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:33.412705 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:33.419790 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:33.420236 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:33.421056 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:33.421488 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:33.811707 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:33.819683 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a4a888ce-c90e-4d7b-b350-ac3ebe8e841b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.411487 Jun 20 06:16:33.820250 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 547/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:33 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:34.837092 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:34.837696 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:34.844626 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.845306 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.846064 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.846511 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.988432 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:34.996820 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-29dbe3c0-4f2d-4882-a8ba-0426420edd4a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.163636 Jun 20 06:16:34.997395 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 569/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:34 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:36.013545 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:36.014183 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:36.020746 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:36.021231 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:36.021990 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:36.022420 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:36.164275 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:36.172133 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4614b8f5-55e5-4dfc-bbc4-e2ccafb89d9f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.162985 Jun 20 06:16:36.172690 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 548/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:36 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:37.189060 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:37.189677 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:37.196399 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:37.196855 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:37.197652 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:37.198085 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:37.337173 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:37.345598 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2a3f9979-5eaf-4f3d-84e4-e78d03d21a3a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.160461 Jun 20 06:16:37.346157 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 570/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:37 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:38.363352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:38.363884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:38.370308 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:38.370754 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:38.371504 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:38.371934 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:38.514668 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:38.522773 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b9f889f4-5569-4de5-92b2-d152016b4d24 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.163318 Jun 20 06:16:38.523329 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 549/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:38 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:39.539865 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:39.540471 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:39.546933 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:39.547375 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:39.548123 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:39.548549 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:39.685795 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:39.694232 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4f73f554-f594-46f6-814d-cda4f43d833f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1756 microversion: 2.1 time: 0.158246 Jun 20 06:16:39.694799 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 571/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:39 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:40.711416 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:40.712040 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:40.718814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.719269 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.720032 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.720788 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.858352 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:40.866228 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9dd8890b-c7c6-4452-82f6-f207909f2940 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1759 microversion: 2.1 time: 0.158693 Jun 20 06:16:40.866814 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 550/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:40 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:13.409274 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2111618210"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:13.409832 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:13.411808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=12 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:13.412616 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:13.418593 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:13.419041 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:13.419807 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:13.420251 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:13.545230 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.network.security_group_api [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Removing security group 3291a9a1-8a19-4108-a8d9-71e0a0775f61 from port 59aeb35c-b619-4c08-b4b1-74464ac0fb52 Jun 20 06:17:13.870787 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fad47970-3280-4573-bd7f-067631efb659 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/action" status: 202 len: 0 microversion: 2.1 time: 0.465344 Jun 20 06:17:13.871610 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 572/1122] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 20 06:17:13 2022] POST /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:13.888230 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-467b624e-d0ed-4995-bad4-7f055322b00b req-2dae0d4d-3049-417b-9fd7-82ee2887c7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:13.900632 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=12 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:13.909274 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=36 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:13.916005 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-467b624e-d0ed-4995-bad4-7f055322b00b req-2dae0d4d-3049-417b-9fd7-82ee2887c7f9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:13.916528 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-467b624e-d0ed-4995-bad4-7f055322b00b req-2dae0d4d-3049-417b-9fd7-82ee2887c7f9 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:13.942749 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-467b624e-d0ed-4995-bad4-7f055322b00b req-2dae0d4d-3049-417b-9fd7-82ee2887c7f9 service nova] Creating event network-changed:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:17:13.948203 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-467b624e-d0ed-4995-bad4-7f055322b00b req-2dae0d4d-3049-417b-9fd7-82ee2887c7f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066810 Jun 20 06:17:13.949301 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 551/1123] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:14.940775 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:14.941552 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:14.942909 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-a42ab07a-f63e-4206-962c-88784ce045f5 req-f985588f-5259-4d99-9a1a-72a368feb32a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:14.948017 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:14.948572 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:14.950002 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:14.950551 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:14.953737 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-a42ab07a-f63e-4206-962c-88784ce045f5 req-f985588f-5259-4d99-9a1a-72a368feb32a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:14.954186 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-a42ab07a-f63e-4206-962c-88784ce045f5 req-f985588f-5259-4d99-9a1a-72a368feb32a service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:14.964599 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-a42ab07a-f63e-4206-962c-88784ce045f5 req-f985588f-5259-4d99-9a1a-72a368feb32a service nova] Creating event network-changed:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:17:14.972163 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-a42ab07a-f63e-4206-962c-88784ce045f5 req-f985588f-5259-4d99-9a1a-72a368feb32a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032897 Jun 20 06:17:14.973597 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 552/1124] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:15.033356 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lazy-loading 'services' on Instance uuid 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:17:15.123618 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b230c9e2-0235-4b13-beef-ad73ea15e3b5 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments/a0c437e5-f8b1-4c53-a3f7-e797c5859d46" status: 202 len: 0 microversion: 2.1 time: 0.187167 Jun 20 06:17:15.124898 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 573/1125] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:17:14 2022] DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments/a0c437e5-f8b1-4c53-a3f7-e797c5859d46 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:15.134980 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:15.136437 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:15.144187 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:15.145037 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:15.146134 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:15.147125 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:15.178103 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2a491240-726a-49da-af24-06e95dfe613a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Jun 20 06:17:15.179030 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 553/1126] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:15 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:16.190135 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:16.191320 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:16.197674 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:16.198218 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.199058 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:16.199501 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.227199 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5e340754-ff70-4b9f-a464-c968befa84e8 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041877 Jun 20 06:17:16.227749 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 574/1127] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:16 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:17:16.238090 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:16.238586 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:16.244890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:16.245373 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.246182 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:16.246617 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.318999 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] HTTP exception thrown: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae is not attached to volume a0c437e5-f8b1-4c53-a3f7-e797c5859d46 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Request method failure captured: Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments/a0c437e5-f8b1-4c53-a3f7-e797c5859d46 HTTP/1.1 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisBB3XKo7Dyoo1e2QSzu5wkhM3qkzDXuAw27Ebn8-P6uZRQvloMF0tCToTWWAyu-rlutV9r8YdQk_TsQsjajW7jondU01kWkjyh5iba3oMwsHmSKKWjhruXdxc55Y5HbSR2mHHZ99C5jn67UBLomH7H6WPCYHBh4S_8--onH3W8jKeC8 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: de6d1de1afba411cbc3593372102768c Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestMinimumBasicScenario-554175069 Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:17:16.321383 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6d1de1afba411cbc3593372102768c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6d1de1afba411cbc3593372102768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6d1de1afba411cbc3593372102768c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6d1de1afba411cbc3593372102768c", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestMinimumBasicScenario-554175069 Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: de6d1de1afba411cbc3593372102768c Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestMinimumBasicScenario-554175069 Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-TestMinimumBasicScenario-554175069-project Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: cf5d1fe915c6487a8f5e803c6ed8adeb Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestMinimumBasicScenario-554175069-project Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:17:16.323029 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae is not attached to volume a0c437e5-f8b1-4c53-a3f7-e797c5859d46 Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'server_id': '3a71746a-06d4-4ac3-9e16-fbeeb6b349ae', 'id': 'a0c437e5-f8b1-4c53-a3f7-e797c5859d46'} Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a0c437e5-f8b1-4c53-a3f7-e797c5859d46. Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:16.323897 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae is not attached to volume a0c437e5-f8b1-4c53-a3f7-e797c5859d46 Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae is not attached to volume a0c437e5-f8b1-4c53-a3f7-e797c5859d46 Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:16.325402 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Returning 404 to user: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae is not attached to volume a0c437e5-f8b1-4c53-a3f7-e797c5859d46 {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:16.326484 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-450ef917-5bd9-458d-b31c-d7054a8b065a tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments/a0c437e5-f8b1-4c53-a3f7-e797c5859d46" status: 404 len: 154 microversion: 2.1 time: 0.088839 Jun 20 06:17:16.326484 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 554/1128] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 20 06:17:16 2022] DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae/os-volume_attachments/a0c437e5-f8b1-4c53-a3f7-e797c5859d46 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:17.460106 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:17.460683 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:17.467866 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:17.468318 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:17.469116 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:17.469559 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:17.493147 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:17:17.564649 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-158b7c12-233b-4677-a9d8-30ab4ad7d8c0 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 204 len: 0 microversion: 2.1 time: 0.108039 Jun 20 06:17:17.565241 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 575/1129] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 20 06:17:17 2022] DELETE /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:17:17.575312 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:17.575929 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:17.582689 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:17.583144 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:17.583907 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:17.584346 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:17.715038 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:17.722419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-73558d22-d96d-4b19-b2e7-a3120c4a7676 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1554 microversion: 2.1 time: 0.152843 Jun 20 06:17:17.722986 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 555/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:17 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:18.739496 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:18.740197 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:18.747525 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:18.748048 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:18.748733 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:18.749288 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:18.883730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:18.891021 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d9cbc2be-6d5c-45d8-ab9a-a1bc73c00e5f tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1554 microversion: 2.1 time: 0.155814 Jun 20 06:17:18.891580 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 576/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:18 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:19.907817 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:19.908421 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:19.915144 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:19.915593 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:19.916384 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:19.916874 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.140590 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-5ed5191b-61db-4658-a471-a0974813160e req-b8e921b5-3ac2-4275-943a-e080f83f8914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a71746a-06d4-4ac3-9e16-fbeeb6b349ae", "name": "network-vif-deleted", "tag": "59aeb35c-b619-4c08-b4b1-74464ac0fb52"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:20.141155 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5d1fe915c6487a8f5e803c6ed8adeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6d1de1afba411cbc3593372102768c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:20.150035 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5ed5191b-61db-4658-a471-a0974813160e req-b8e921b5-3ac2-4275-943a-e080f83f8914 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.150786 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5ed5191b-61db-4658-a471-a0974813160e req-b8e921b5-3ac2-4275-943a-e080f83f8914 service nova] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.151940 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-19a63ddd-a302-4124-98b5-743edc25727b tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 200 len: 1554 microversion: 2.1 time: 0.248158 Jun 20 06:17:20.152513 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 556/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:19 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:20.314655 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-5ed5191b-61db-4658-a471-a0974813160e req-b8e921b5-3ac2-4275-943a-e080f83f8914 service nova] Creating event network-vif-deleted:59aeb35c-b619-4c08-b4b1-74464ac0fb52 for instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae on hv-cinder-83699 Jun 20 06:17:20.319730 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-5ed5191b-61db-4658-a471-a0974813160e req-b8e921b5-3ac2-4275-943a-e080f83f8914 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183880 Jun 20 06:17:20.320613 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 577/1133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:20.477480 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:17:20.477704 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Mon Jun 20 06:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:17:21.170543 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:21.171344 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] [instance: 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:21.177890 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:21.178343 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:21.179109 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:21.179549 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Lock "40624e2c-0e91-4c97-b143-ade440b678f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:21.195300 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] HTTP exception thrown: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae could not be found. Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Request method failure captured: Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae HTTP/1.1 Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept: application/json Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Connection: close Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Host: 10.222.0.20 Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABisBB3XKo7Dyoo1e2QSzu5wkhM3qkzDXuAw27Ebn8-P6uZRQvloMF0tCToTWWAyu-rlutV9r8YdQk_TsQsjajW7jondU01kWkjyh5iba3oMwsHmSKKWjhruXdxc55Y5HbSR2mHHZ99C5jn67UBLomH7H6WPCYHBh4S_8--onH3W8jKeC8 Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Id: de6d1de1afba411cbc3593372102768c Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestMinimumBasicScenario-554175069 Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Role: reader,member Jun 20 06:17:21.196833 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Roles: reader,member Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6d1de1afba411cbc3593372102768c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6d1de1afba411cbc3593372102768c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6d1de1afba411cbc3593372102768c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6d1de1afba411cbc3593372102768c", "adminURL": "http://10.222.0.20:8080"}]}] Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestMinimumBasicScenario-554175069 Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Id: de6d1de1afba411cbc3593372102768c Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestMinimumBasicScenario-554175069 Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User: tempest-TestMinimumBasicScenario-554175069-project Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Id: cf5d1fe915c6487a8f5e803c6ed8adeb Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestMinimumBasicScenario-554175069-project Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: method: > Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: exception: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae could not be found. Jun 20 06:17:21.198461 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: action_args: {'id': '3a71746a-06d4-4ac3-9e16-fbeeb6b349ae'} Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae could not be found. Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:21.199419 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae could not be found. Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae could not be found. Jun 20 06:17:21.201552 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jun 20 06:17:21.203108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Returning 404 to user: Instance 3a71746a-06d4-4ac3-9e16-fbeeb6b349ae could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:21.203108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-22a68e4c-b43a-4c4b-a26b-7c82b00f90db tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae" status: 404 len: 111 microversion: 2.1 time: 0.032730 Jun 20 06:17:21.203108 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 557/1134] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:21 2022] GET /compute/v2.1/servers/3a71746a-06d4-4ac3-9e16-fbeeb6b349ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:21.208534 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6ddd089d-dd47-4fc5-a237-21027d3ab380 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] Calling method '.version_select at 0x7f9d4899baf0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:21.225823 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6ddd089d-dd47-4fc5-a237-21027d3ab380 tempest-TestMinimumBasicScenario-554175069 tempest-TestMinimumBasicScenario-554175069-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-147250979" status: 202 len: 0 microversion: 2.1 time: 0.021842 Jun 20 06:17:21.226361 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 578/1135] 10.222.0.20 () {58 vars in 1268 bytes} [Mon Jun 20 06:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-147250979 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:18:53.251941 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:18:53.252497 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Mon Jun 20 06:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:19:26.118267 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:19:26.118884 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Mon Jun 20 06:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:20:40.486808 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:20:40.487396 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Mon Jun 20 06:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:20:40.644367 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:20:40.644806 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Mon Jun 20 06:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:22:13.260113 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:22:13.260898 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Mon Jun 20 06:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:22:21.293899 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:22:21.294329 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Mon Jun 20 06:22:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:22:32.732569 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:22:32.733225 dv-cinder-836996-36-iscsi devstack@n-api.service[117666]: Mon Jun 20 06:22:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:22:46.126673 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:22:46.127221 dv-cinder-836996-36-iscsi devstack@n-api.service[117665]: Mon Jun 20 06:22:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!